-- Logs begin at Mon 2022-08-01 14:23:30 UTC, end at Mon 2022-08-01 15:32:55 UTC. -- Aug 01 15:02:51.475248 dv-cinder-803823-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:02:51.486819 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:02:51 2022] *** Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: nodename: dv-cinder-803823-14-iscsi Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: machine: x86_64 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: clock source: unix Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: pcre jit disabled Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: detected number of CPU cores: 4 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: current working directory: / Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: your processes number limit is 47680 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: your memory page size is 4096 bytes Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: detected max file descriptor number: 2048 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: lock engine: pthread robust mutexes Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: thunder lock: enabled Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:02:51.488506 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:02:51.530015 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: Python main interpreter initialized at 0x5577bac139c0 Aug 01 15:02:51.530015 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: python threads support enabled Aug 01 15:02:51.530015 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: your server socket listen backlog is limited to 100 connections Aug 01 15:02:51.530015 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: *** Operational MODE: preforking *** Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: spawned uWSGI master process (pid: 103414) Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: spawned uWSGI worker 1 (pid: 103415, cores: 1) Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: spawned uWSGI worker 2 (pid: 103416, cores: 1) Aug 01 15:02:51.532349 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:02:51.530940 dv-cinder-803823-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:02:52.214641 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:02:52.216089 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:02:53.333455 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:02:53.333455 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: from cryptography.utils import int_from_bytes Aug 01 15:02:53.333455 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:02:53.333455 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: from cryptography.utils import int_from_bytes Aug 01 15:02:53.334341 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:02:53.334341 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: from cryptography.utils import int_from_bytes Aug 01 15:02:53.334750 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:02:53.334750 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: from cryptography.utils import int_from_bytes Aug 01 15:02:55.888765 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:02:55.889458 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:02:55.889549 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:02:55.889908 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:02:55.889988 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:02:55.890058 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:02:55.890131 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:02:55.890198 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:02:55.890465 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:02:55.890586 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.890723 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:02:55.890813 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891108 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891196 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891536 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891760 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.891848 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892080 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892179 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892413 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892528 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892757 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.892852 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893081 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893198 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893354 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893442 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893665 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893764 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.893963 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894065 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-14-iscsi {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894285 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894383 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894586 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894694 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-14-iscsi {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894888 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.894984 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895202 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895292 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895501 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895591 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895817 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.895915 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.896115 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.896208 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.896436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.896638 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.896753 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897074 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897259 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897385 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897572 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897716 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.897961 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898096 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898204 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898317 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898526 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898660 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898809 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.898900 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899117 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899207 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899440 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899529 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899749 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.899842 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900107 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900220 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-14-iscsi {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900423 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900535 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900831 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.900973 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-14-iscsi {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901140 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901228 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901456 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901541 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901771 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.901879 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902129 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902252 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902541 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902643 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902785 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.902924 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903088 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903186 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903522 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903625 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903707 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.903786 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904017 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904124 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904370 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904497 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904657 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904792 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.904958 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905073 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905261 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905363 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905567 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905654 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905861 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.905966 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906158 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906254 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906404 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906492 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906704 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906802 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.906994 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907090 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907302 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907389 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907615 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907705 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907861 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.907949 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908105 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908228 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908421 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908655 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908743 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.908835 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909045 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909137 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909344 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909651 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909750 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.909952 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910042 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910252 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910368 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910551 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910667 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910850 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.910942 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911150 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911305 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911446 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911733 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.911885 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912099 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912195 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912343 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912431 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912681 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912782 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.912987 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913080 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913306 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913405 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913606 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913693 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.913941 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914030 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914252 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914368 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914557 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914683 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914865 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.914956 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915180 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915294 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915481 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915571 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915780 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.915876 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916078 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916180 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916389 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916516 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916719 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.916809 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917021 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917119 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917268 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917357 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917563 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917689 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917897 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.917989 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918213 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918329 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918511 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918657 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918811 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.918909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919111 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919200 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919404 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919494 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919707 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.919798 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920004 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920151 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920302 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920401 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920626 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920725 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.920933 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921036 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921224 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921322 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921525 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921663 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921822 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.921958 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922118 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922217 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922520 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922623 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922722 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.922804 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923019 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923132 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923314 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923404 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923614 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923784 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.923911 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924014 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924219 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924537 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924655 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924841 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.924989 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925146 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925235 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925440 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925529 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.925835 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926048 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926135 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926426 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926520 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926644 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926747 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.926951 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927043 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927241 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927328 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927539 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927629 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.927898 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928000 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928141 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928231 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928446 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928586 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928761 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.928855 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929058 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929157 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929354 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929445 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929655 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929742 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.929947 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930038 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930241 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930342 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930540 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930626 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930843 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.930943 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931140 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931236 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931449 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931546 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931749 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.931886 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.932044 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.932204 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.932354 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.932536 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.932718 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.932839 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.933044 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.933158 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:02:55.933890 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934020 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934205 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934357 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934532 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934711 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.934856 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935032 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935169 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935368 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935457 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935702 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.935790 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936023 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936120 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936338 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936426 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936680 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936770 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.936985 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937092 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937298 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937386 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937611 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937698 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.937927 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938015 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938233 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938334 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938544 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938653 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938853 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.938952 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939157 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939246 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939468 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939556 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939784 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.939884 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940099 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940187 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940399 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940521 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940865 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.940969 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941103 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941192 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941413 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941511 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941733 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.941869 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942053 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942149 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942358 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942458 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942662 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942751 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.942964 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943052 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943285 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943394 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943610 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943700 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.943916 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944005 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944230 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944328 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944652 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944899 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.944997 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945175 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945351 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945555 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945639 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945772 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.945870 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946107 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946227 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946414 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946510 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946722 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.946811 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947027 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947129 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947339 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947435 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947644 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947733 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.947947 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948048 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948252 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948352 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948583 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948725 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948881 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.948980 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.949740 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.949847 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950057 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950166 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950402 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950575 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950715 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.950841 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951001 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951093 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951311 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951402 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951635 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951724 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.951933 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952020 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952240 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952331 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952571 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952665 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952880 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.952983 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953181 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953302 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953487 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953590 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953790 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.953889 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954089 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954191 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954405 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954501 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954709 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.954808 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955011 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955106 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955330 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955422 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955631 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955729 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.955932 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956020 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956244 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956333 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956572 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956663 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956883 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.956970 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957192 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957281 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957497 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957587 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957812 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.957901 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958117 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958215 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958429 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958618 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958754 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.958834 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959171 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959370 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959458 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959691 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.959781 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960017 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960115 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960331 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960438 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960656 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960747 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.960963 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961103 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961264 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961563 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961691 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961889 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.961994 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962197 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962297 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962506 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962609 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962812 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.962914 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963179 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963283 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963497 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963597 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963718 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.963938 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964076 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964219 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964354 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964502 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964606 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964691 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.964964 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965061 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965283 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965433 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965561 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965660 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965866 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.965956 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966170 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966258 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966516 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966606 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966824 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.966913 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967138 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967237 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967448 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967545 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967760 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.967849 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968068 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968166 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968378 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968487 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968719 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.968827 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969027 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969160 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969340 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969439 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969640 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969729 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.969951 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970047 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970254 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970359 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970570 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970662 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970876 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.970966 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971188 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971315 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971539 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971694 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971845 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.971948 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972110 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972198 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972413 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972521 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972756 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.972847 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973071 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973159 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973380 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973469 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973693 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.973814 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974001 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974102 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974308 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974416 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974623 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974894 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.974988 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975078 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975227 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975470 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975544 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975611 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975833 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.975922 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976139 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976296 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976434 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976578 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976772 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.976861 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977081 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977178 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977399 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977487 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977707 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.977794 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978029 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978131 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978375 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978484 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978651 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978745 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.978955 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979051 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979272 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979379 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979581 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979684 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979887 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.979977 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980197 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980320 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980563 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980659 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980883 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.980977 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981283 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981388 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981470 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981557 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981770 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.981872 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982075 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982187 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982378 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982527 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982687 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982777 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.982987 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983086 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983285 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983388 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983583 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983672 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983886 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.983975 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.984190 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.984288 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.984516 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.984623 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.984940 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985044 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985151 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985250 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985450 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985562 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985750 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.985859 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986064 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986175 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986370 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986460 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986668 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986757 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.986968 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987059 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987267 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987580 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987668 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987889 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.987987 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988184 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988279 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988517 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988610 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988842 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.988940 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989145 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989248 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989457 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989557 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989760 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.989853 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990069 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990167 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990384 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990481 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990690 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.990785 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991247 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991337 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991558 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991669 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991858 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.991947 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992157 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992253 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992456 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992586 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992791 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.992879 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993093 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993188 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993400 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993504 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993706 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.993795 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994003 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994092 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994309 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994401 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994618 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994705 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.994933 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.995196 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.995294 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.995528 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.995618 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.995846 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.996651 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.996852 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.996978 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997169 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997295 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997484 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997618 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997810 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.997940 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998137 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998262 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998486 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998586 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998792 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.998890 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999101 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999238 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999404 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999577 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999719 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:55.999859 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000050 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000163 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000310 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000439 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000634 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000775 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.000943 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001137 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001250 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001376 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001636 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001858 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.001957 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002040 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002127 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002274 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002511 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002600 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002829 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.002920 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003187 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003293 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003463 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003551 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003764 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.003854 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004078 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004196 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004383 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004498 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004713 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.004814 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005011 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005100 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005304 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005404 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005633 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005731 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.005944 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006148 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006303 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006450 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006592 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006724 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.006897 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007036 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007202 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007353 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007498 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007635 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007811 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.007956 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008102 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008239 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008399 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008524 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008727 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.008825 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009126 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009347 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009435 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009646 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009734 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.009957 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010053 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010262 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010352 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010572 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010659 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010877 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.010966 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.011177 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.011274 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.011482 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012168 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012354 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012452 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012670 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012794 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.012977 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.013102 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.013294 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.013390 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.013611 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.013731 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014046 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014168 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014249 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014331 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014521 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014637 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014832 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.014942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015138 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015237 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015444 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015549 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015746 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.015848 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016048 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016155 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016348 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016447 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016676 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016767 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.016980 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017281 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017385 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017663 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017772 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.017969 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018067 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018274 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018379 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018611 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018753 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018895 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.018983 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019206 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019318 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019520 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019678 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019824 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.019915 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020116 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020242 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020428 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020538 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020778 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.020866 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021094 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021193 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021403 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021500 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021716 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.021805 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022015 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022111 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022325 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022434 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022628 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022784 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.022931 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023022 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023231 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023321 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023537 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023748 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.023879 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024132 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024223 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024439 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024573 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024788 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.024889 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025103 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025191 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025416 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025515 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025731 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.025890 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026041 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026413 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026577 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026681 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026776 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.026860 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027044 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027221 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027381 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027508 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027701 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.027803 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028025 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028144 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028345 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028532 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028744 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028834 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.028977 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029098 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029286 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029594 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029736 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.029893 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030023 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030171 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030297 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030490 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030639 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.030863 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031015 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031125 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031223 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031439 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031539 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031754 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.031865 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032075 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032188 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032399 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032605 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032726 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.032866 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033025 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033164 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033483 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033640 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033799 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.033939 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034110 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034238 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034425 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034640 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034732 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.034846 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035034 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035153 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035356 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035453 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035671 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035777 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.035986 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036085 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036298 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036429 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036636 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036737 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.036952 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037041 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037266 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037356 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037570 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037672 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037872 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.037970 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038214 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038313 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038516 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038607 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038825 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.038912 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039125 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039222 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039434 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039560 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039740 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.039868 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040176 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040263 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040501 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040597 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040814 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.040904 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041121 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041210 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041432 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041523 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041745 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.041841 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042044 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042141 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042376 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042478 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042683 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.042800 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043081 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043193 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043385 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043476 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043687 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043776 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.043986 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044090 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044294 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044383 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044638 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044770 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.044942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045047 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045243 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045352 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045541 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045639 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045860 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.045952 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.046156 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.046254 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.046505 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.046603 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.046833 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047009 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047156 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047321 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047575 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047665 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.047894 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048018 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048202 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048324 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048653 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048745 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.048968 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049069 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049280 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049375 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049593 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049694 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049894 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.049983 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050201 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050318 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050511 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050648 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050825 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.050927 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051140 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051275 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051444 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051541 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051754 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.051861 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052051 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052141 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052368 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052508 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052699 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.052802 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053016 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053191 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053334 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053414 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053653 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053816 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.053968 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054113 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054337 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054652 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054743 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.054971 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055071 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055270 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055360 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055570 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055668 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055875 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.055974 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056174 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056272 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056487 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056629 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056810 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.056903 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057108 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057197 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057413 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057503 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057717 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.057806 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.058021 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.058119 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.058319 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.058977 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059223 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059326 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059449 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059547 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059750 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.059838 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060067 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060164 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060373 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060499 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060722 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.060824 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061041 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061131 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061341 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061439 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061658 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061748 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.061964 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062060 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062266 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062357 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062565 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062656 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062866 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.062969 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063174 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063403 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063479 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063561 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063797 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.063894 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064101 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064191 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064599 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064716 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064802 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.064882 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065070 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065169 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065391 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065545 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065705 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.065804 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066022 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066120 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066464 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066578 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066708 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066808 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.066928 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067008 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067232 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067321 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067536 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067688 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067826 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.067932 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068124 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068225 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068415 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068612 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068769 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.068868 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069037 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069127 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069334 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069645 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069741 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.069940 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070029 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070253 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070357 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070559 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070657 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070860 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.070957 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071161 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071241 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071567 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071708 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071833 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.071918 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.072063 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.072192 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.072450 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.072743 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.072857 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073074 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073202 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073397 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073548 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073724 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.073969 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.074206 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.074939 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.075182 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.075325 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.075546 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.075817 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.075959 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.076339 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.076450 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.076705 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.076783 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.076910 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077153 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077242 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077548 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077627 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077867 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.077953 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078185 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078263 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078505 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078599 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078825 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.078943 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.079151 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.079262 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.079585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.079734 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.081934 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090181 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090365 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090451 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090451 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090580 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090649 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090729 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090800 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.090877 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091010 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091171 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091272 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091425 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091513 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091584 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091651 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091728 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091798 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.091873 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092025 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092150 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092254 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092339 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092426 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092516 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092708 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092792 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092864 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.092932 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093000 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093000 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093122 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093198 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093330 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093427 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093502 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093572 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093676 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093773 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093857 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093926 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.093993 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094060 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094136 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094205 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094272 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094355 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094430 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094512 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094582 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094650 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094745 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.094888 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095034 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095193 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095343 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095487 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095618 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095747 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.095875 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096031 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096177 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096301 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096426 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096597 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096755 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.096896 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097027 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097157 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097295 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097422 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097566 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097669 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097739 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097817 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097886 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.097954 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098031 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098099 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098180 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098249 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098317 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098411 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098496 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098582 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098693 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098778 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098868 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.098949 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099026 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099109 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099190 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099271 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099361 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099509 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099651 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099794 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.099794 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100056 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100056 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100325 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100325 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100682 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.100883 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101033 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101159 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101308 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101448 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101596 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101596 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101851 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.101851 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102042 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102189 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102341 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102485 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102589 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102839 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.102932 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103016 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103085 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103153 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103221 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103301 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103384 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103474 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103556 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103625 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103692 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103768 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103838 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103906 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.103973 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104048 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104124 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104207 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104287 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104368 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104449 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104557 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104636 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104720 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104801 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.104914 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105011 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105094 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105189 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105189 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105438 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105531 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105602 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105669 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105745 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105814 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105882 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.105948 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106015 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106091 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106161 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106241 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106327 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106606 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106698 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106787 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.106945 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107085 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107256 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107388 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107565 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107664 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107872 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.107962 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108189 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108298 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108514 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108624 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108836 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.108986 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.109196 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.109344 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.109527 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.109630 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.109895 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110062 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110157 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110248 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110447 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110632 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110762 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.110854 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111089 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111232 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111395 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111515 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111697 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.111787 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.112044 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.112140 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.112546 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.112650 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.112975 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113086 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113315 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113461 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113639 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113792 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.113980 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114147 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114317 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114479 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114629 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114786 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.114939 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.115089 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.115248 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.115424 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.115563 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.115798 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.116224 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.116436 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.116576 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.116776 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.116907 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117090 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117235 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117404 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117510 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117720 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.117805 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118032 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118141 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118347 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118475 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118657 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118795 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.118967 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119096 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119286 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119435 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119583 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119712 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.119891 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120021 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120203 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120293 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120542 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120709 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.120877 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.121526 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122008 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122151 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122303 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122458 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122458 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122756 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.122931 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123073 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123198 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123336 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123460 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123585 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123707 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123833 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.123952 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124095 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124230 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124374 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124530 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124664 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124792 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.124942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.125101 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.125253 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.125528 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.125680 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.125860 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126001 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126151 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126289 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126448 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126602 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126755 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.126881 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127080 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127260 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127409 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127540 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127723 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.127879 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128046 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128139 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128360 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128490 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.128790 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129018 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129106 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129362 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129550 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129684 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129773 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.129993 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130084 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130293 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130433 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130593 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130692 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130893 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.130981 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.131201 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.131332 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.131507 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.131648 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.131817 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132007 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132187 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132308 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132450 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132716 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132716 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.132986 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133148 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133251 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133333 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133413 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133599 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133689 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.133925 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134013 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134230 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134318 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134529 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134625 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134828 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.134916 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135126 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135223 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135424 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135521 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135724 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.135812 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.136021 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.136108 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.136326 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.136444 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137226 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137410 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137533 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137664 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137798 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.137933 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.138098 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.138327 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.138441 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.138714 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.138857 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139043 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139133 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139359 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139473 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139677 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.139817 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140073 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140216 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140351 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140532 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140671 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140768 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.140916 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141069 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141235 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141365 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141554 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141655 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141859 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.141948 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142191 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142391 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142492 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142575 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142793 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.142881 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143101 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143193 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143410 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143500 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143756 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.143868 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144022 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144111 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144353 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144447 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144710 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.144787 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145024 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145130 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145343 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145431 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145661 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145749 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.145975 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146088 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146282 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146371 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146589 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146681 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.146914 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147012 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147222 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147320 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147531 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147620 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147840 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.147929 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148148 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148236 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148457 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148560 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148792 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.148906 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149100 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149189 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149407 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149499 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149719 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.149815 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150032 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150139 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150374 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150473 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150671 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150767 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.150977 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151073 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151297 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151394 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151621 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151711 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.151970 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.152059 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.152317 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.152483 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.152691 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.152811 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153100 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153207 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153337 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153438 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153647 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153737 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.153953 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.154042 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:02:56.154326 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:02:56.154433 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:02:56.309641 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO dbcounter [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Registered counter for database nova_api Aug 01 15:02:56.309856 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO dbcounter [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Registered counter for database nova_api Aug 01 15:02:56.330540 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_db.sqlalchemy.engines [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.333236 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_db.sqlalchemy.engines [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.337639 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writer thread running {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.340015 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writer thread running {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.394514 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.context [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9208223d-c65f-412b-8e82-b4c7b944694f(cell1) {{(pid=103415) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:02:56.397114 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.context [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9208223d-c65f-412b-8e82-b4c7b944694f(cell1) {{(pid=103416) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:02:56.398503 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:02:56.400099 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:02:56.400934 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:02:56.401156 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_concurrency.lockutils [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:02:56.402791 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_concurrency.lockutils [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:02:56.402966 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:02:56.403599 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_concurrency.lockutils [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:02:56.405003 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO dbcounter [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Registered counter for database nova_cell0 Aug 01 15:02:56.405620 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_concurrency.lockutils [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:02:56.407644 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO dbcounter [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Registered counter for database nova_cell0 Aug 01 15:02:56.410666 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO dbcounter [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Registered counter for database nova_cell1 Aug 01 15:02:56.413424 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO dbcounter [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Registered counter for database nova_cell1 Aug 01 15:02:56.419122 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_db.sqlalchemy.engines [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.421506 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_db.sqlalchemy.engines [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.423067 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_db.sqlalchemy.engines [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.425121 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_db.sqlalchemy.engines [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.426983 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writer thread running {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.429960 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writer thread running {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.430382 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writer thread running {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.433247 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writer thread running {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.580921 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO dbcounter [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Registered counter for database nova_cell0 Aug 01 15:02:56.584880 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO dbcounter [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Registered counter for database nova_cell0 Aug 01 15:02:56.593458 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_db.sqlalchemy.engines [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.597251 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG oslo_db.sqlalchemy.engines [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:02:56.599074 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writer thread running {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.602090 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writer thread running {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:02:56.944295 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: WARNING keystonemiddleware.auth_token [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:02:56.945797 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: WARNING keystonemiddleware.auth_token [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:02:56.952268 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: WARNING keystonemiddleware.auth_token [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:02:56.953739 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: WARNING keystonemiddleware.auth_token [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:02:57.298440 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: WARNING keystonemiddleware.auth_token [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:02:57.298640 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: WARNING keystonemiddleware.auth_token [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:02:57.304488 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: WARNING keystonemiddleware.auth_token [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:02:57.304657 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: WARNING keystonemiddleware.auth_token [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:02:57.310386 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577bac139c0 pid: 103416 (default app) Aug 01 15:02:57.310538 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5577bac139c0 pid: 103415 (default app) Aug 01 15:02:57.312537 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:02:57.313717 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-9cecd557-7676-4f1d-aff6-a763911d3110 None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001812 Aug 01 15:02:57.314115 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Mon Aug 1 15:02:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:17.812252 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:17.813502 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Aug 01 15:04:17.814084 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 1/2] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:17.826450 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_api:SELECT=3 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:17.827196 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_cell0:SELECT=3 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:17.827804 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_cell1:SELECT=3 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:17.828759 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:18.778347 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-ffb16004-46a5-4f4b-8be6-ce36862f0386 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:18.812933 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-ffb16004-46a5-4f4b-8be6-ce36862f0386 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.992438 Aug 01 15:04:18.814691 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 2/3] 10.222.0.93 () {60 vars in 1291 bytes} [Mon Aug 1 15:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:21.232368 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:21.233448 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-f6fb15fd-c8dd-49ad-be92-4047ed28cea1 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 01 15:04:21.237196 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 2/4] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:04:21.786090 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-28d0444b-c011-4fac-973d-c34adb59a8ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "ram": 256, "id": "c1"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:21.831569 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:04:21.831569 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: warnings.warn(msg) Aug 01 15:04:21.868977 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-28d0444b-c011-4fac-973d-c34adb59a8ea admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.628040 Aug 01 15:04:21.878841 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 3/5] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:04:21.890494 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_api:SELECT=3 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:21.896731 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_cell0:SELECT=3 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:21.896731 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_cell1:SELECT=3 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:21.896731 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:22.112807 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-7de0414a-69a0-4f41-a581-3052d785e347 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:22.117649 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:04:22.117649 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:04:22.186493 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-7de0414a-69a0-4f41-a581-3052d785e347 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306028 Aug 01 15:04:22.187084 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 3/6] 10.222.0.93 () {64 vars in 1335 bytes} [Mon Aug 1 15:04:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:24.488631 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-28d0444b-c011-4fac-973d-c34adb59a8ea admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:24.489645 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-28d0444b-c011-4fac-973d-c34adb59a8ea admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 01 15:04:24.495837 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 4/7] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:25.277031 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-1c4fe51a-8951-466d-a31e-a45a76a2a99b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:25.296392 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:04:25.296392 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:04:25.320522 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-1c4fe51a-8951-466d-a31e-a45a76a2a99b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.822374 Aug 01 15:04:25.329072 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 4/8] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:25.335606 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-42029fce-6550-4a7f-80bb-3f1ef0a07dbc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:25.339202 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:04:25.339202 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: warnings.warn(msg) Aug 01 15:04:25.387860 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-42029fce-6550-4a7f-80bb-3f1ef0a07dbc admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055992 Aug 01 15:04:25.389149 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 5/9] 10.222.0.93 () {64 vars in 1335 bytes} [Mon Aug 1 15:04:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:28.042722 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-1c4fe51a-8951-466d-a31e-a45a76a2a99b admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:28.043905 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-1c4fe51a-8951-466d-a31e-a45a76a2a99b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Aug 01 15:04:28.044596 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 5/10] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:28.500901 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-1d4c7ef4-515e-436b-a2be-6d4b86920a8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "id": "d2", "swap": 0}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:28.525069 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-1d4c7ef4-515e-436b-a2be-6d4b86920a8e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473858 Aug 01 15:04:28.525662 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 6/11] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:28.537685 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-d22f18f1-b6ca-4a67-8c65-cf80bd3e2a4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:28.565062 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-d22f18f1-b6ca-4a67-8c65-cf80bd3e2a4b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030930 Aug 01 15:04:28.565705 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 6/12] 10.222.0.93 () {64 vars in 1335 bytes} [Mon Aug 1 15:04:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:30.847561 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-1d4c7ef4-515e-436b-a2be-6d4b86920a8e admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:30.849376 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-1d4c7ef4-515e-436b-a2be-6d4b86920a8e admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002573 Aug 01 15:04:30.850091 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 7/13] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:31.434957 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-00db20a3-32c9-41cd-b2d6-3572547a7936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "id": "d3"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:31.457740 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-00db20a3-32c9-41cd-b2d6-3572547a7936 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597852 Aug 01 15:04:31.458851 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 7/14] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:31.475414 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-cbb7fc35-7c66-4a64-b3c3-1b20c74ceac7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:31.519184 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-cbb7fc35-7c66-4a64-b3c3-1b20c74ceac7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051092 Aug 01 15:04:31.528616 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 8/15] 10.222.0.93 () {64 vars in 1335 bytes} [Mon Aug 1 15:04:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:33.912242 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-00db20a3-32c9-41cd-b2d6-3572547a7936 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:33.913297 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-00db20a3-32c9-41cd-b2d6-3572547a7936 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 01 15:04:33.913698 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 8/16] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:34.392192 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:34.412543 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492682 Aug 01 15:04:34.413331 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 9/17] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:04:34.425795 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-4ef4558e-2479-48e1-874e-870c77ba8c20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:34.452135 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-4ef4558e-2479-48e1-874e-870c77ba8c20 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030090 Aug 01 15:04:34.453174 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 9/18] 10.222.0.93 () {64 vars in 1335 bytes} [Mon Aug 1 15:04:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:04:36.980373 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:36.981766 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002743 Aug 01 15:04:36.982176 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 10/19] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:37.515723 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-9da62e8f-d7dd-4f4b-9216-27b17b2f85f4 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:37.549672 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-9da62e8f-d7dd-4f4b-9216-27b17b2f85f4 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.558151 Aug 01 15:04:37.550710 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 10/20] 10.222.0.93 () {60 vars in 1291 bytes} [Mon Aug 1 15:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:04:40.378546 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:40.378546 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a3225a72-fd4e-446f-a8b8-280ac843b965 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 01 15:04:40.379153 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 11/21] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:40.913959 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-c57c65fa-ec3a-4c24-a357-f143c496e75f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:40.939715 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-c57c65fa-ec3a-4c24-a357-f143c496e75f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.552151 Aug 01 15:04:40.940288 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 11/22] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:40.958091 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-fe81f741-3180-45ad-8db8-6e03710a524c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:40.996277 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-fe81f741-3180-45ad-8db8-6e03710a524c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041960 Aug 01 15:04:40.996954 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 12/23] 10.222.0.93 () {64 vars in 1332 bytes} [Mon Aug 1 15:04:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:43.316142 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-c57c65fa-ec3a-4c24-a357-f143c496e75f admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:43.317115 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-c57c65fa-ec3a-4c24-a357-f143c496e75f admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 01 15:04:43.317895 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 12/24] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:43.724208 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-88d06c9c-8042-43c8-a1cc-843fb63d2c95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:43.743723 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-88d06c9c-8042-43c8-a1cc-843fb63d2c95 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419189 Aug 01 15:04:43.744791 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 13/25] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:43.757163 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-54ca2109-f6e0-48a5-a39c-e30ea77d4a21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:43.793000 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-54ca2109-f6e0-48a5-a39c-e30ea77d4a21 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039755 Aug 01 15:04:43.793573 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 13/26] 10.222.0.93 () {64 vars in 1332 bytes} [Mon Aug 1 15:04:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:46.202792 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-88d06c9c-8042-43c8-a1cc-843fb63d2c95 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:46.204417 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-88d06c9c-8042-43c8-a1cc-843fb63d2c95 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 01 15:04:46.205107 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 14/27] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:46.682004 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-a15fabdd-ab9d-4d0e-a2b1-28d5badb5997 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "id": "3"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:46.702567 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-a15fabdd-ab9d-4d0e-a2b1-28d5badb5997 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.491648 Aug 01 15:04:46.703269 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 14/28] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:46.717886 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-5acba6c1-12f2-4d2f-b766-9eaec4d0d635 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:46.752545 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-5acba6c1-12f2-4d2f-b766-9eaec4d0d635 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038249 Aug 01 15:04:46.753735 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 15/29] 10.222.0.93 () {64 vars in 1332 bytes} [Mon Aug 1 15:04:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:49.054786 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-a15fabdd-ab9d-4d0e-a2b1-28d5badb5997 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:49.056727 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-a15fabdd-ab9d-4d0e-a2b1-28d5badb5997 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002548 Aug 01 15:04:49.057741 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 15/30] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:04:49.528937 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-2e24a51e-580b-4ae2-9302-799adba7092b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "swap": 0}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:49.537802 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:49.555283 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-2e24a51e-580b-4ae2-9302-799adba7092b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.490920 Aug 01 15:04:49.556075 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 16/31] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:49.568090 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-5bba347d-772b-4c71-a42a-3bab036b7b8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:49.595946 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-5bba347d-772b-4c71-a42a-3bab036b7b8c admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031409 Aug 01 15:04:49.596836 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 16/32] 10.222.0.93 () {64 vars in 1332 bytes} [Mon Aug 1 15:04:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:04:51.869968 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-2e24a51e-580b-4ae2-9302-799adba7092b admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:04:51.870972 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-2e24a51e-580b-4ae2-9302-799adba7092b admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Aug 01 15:04:51.871799 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 17/33] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:04:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:04:52.339193 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:52.350243 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:04:52.364455 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.486578 Aug 01 15:04:52.365115 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 17/34] 10.222.0.93 () {64 vars in 1282 bytes} [Mon Aug 1 15:04:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:04:52.377979 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a53d1ff5-150c-4b21-8046-972bf170fd2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:04:52.409663 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a53d1ff5-150c-4b21-8046-972bf170fd2f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035321 Aug 01 15:04:52.411143 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 18/35] 10.222.0.93 () {64 vars in 1332 bytes} [Mon Aug 1 15:04:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:05:10.987598 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:10.988734 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Aug 01 15:05:10.989236 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 18/36] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:11.000444 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:05:11.481605 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-78b0097f-c3c9-4a4a-a361-2eac3f34fb5d admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:11.501996 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-78b0097f-c3c9-4a4a-a361-2eac3f34fb5d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.505837 Aug 01 15:05:11.502894 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 19/37] 10.222.0.93 () {60 vars in 1291 bytes} [Mon Aug 1 15:05:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:12.643778 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:12.644874 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-e77e27b7-1b08-4040-afdd-9bca4fb8de62 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Aug 01 15:05:12.645294 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 19/38] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:13.207127 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-eadcdc01-38c9-4db1-9375-efcce3324e44 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:13.214028 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.wsgi [None req-eadcdc01-38c9-4db1-9375-efcce3324e44 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-eadcdc01-38c9-4db1-9375-efcce3324e44 admin admin] Request method failure captured: Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept: application/json Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept-Encoding: gzip, deflate Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Connection: keep-alive Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Content-Length: 0 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Host: 10.222.0.93 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-System-Scope: None Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: User-Agent: python-novaclient Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Auth-Token: gAAAAABi5-uojmpZ257KYGE1LyWNBwAIlILotzML644q42Ka8J3_i_L5VtZKC3y5TufNdvqoO3UHo8uI-RVudDXfizd4SREspecO_shgSgIT4ToLQy7fv9wp9MWNp42xxDeqcPSehPyDMMQFG73pHUeALarVx4z3rceQbUR33jmYcqMdKzZ_wZ4 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Id: None Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Name: None Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Identity-Status: Confirmed Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Is-Admin-Project: True Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Id: default Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Name: Default Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Name: admin Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Role: member,reader,admin Aug 01 15:05:13.217457 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Roles: member,reader,admin Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant: admin Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Name: admin Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User: admin Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Id: default Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Name: Default Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Name: admin Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: method: > Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: exception: Flavor 42 could not be found. Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: action_args: {'id': '42'} Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:13.220909 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:13.222243 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.223630 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-eadcdc01-38c9-4db1-9375-efcce3324e44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:13.225142 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-eadcdc01-38c9-4db1-9375-efcce3324e44 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.436211 Aug 01 15:05:13.225142 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 20/39] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Aug 1 15:05:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:05:13.232562 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-b5d20b2c-a353-4c21-a76c-6ddd6ed3a909 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:13.258142 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-b5d20b2c-a353-4c21-a76c-6ddd6ed3a909 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030367 Aug 01 15:05:13.258727 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 20/40] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:05:13.269174 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a028ecb9-f6b5-4c35-a170-3f3928a39179 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:13.294221 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a028ecb9-f6b5-4c35-a170-3f3928a39179 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028671 Aug 01 15:05:13.294791 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 21/41] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:13.312199 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-de524a90-1e81-4071-b6b5-33ecd83549b0 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:13.319152 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.wsgi [None req-de524a90-1e81-4071-b6b5-33ecd83549b0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-de524a90-1e81-4071-b6b5-33ecd83549b0 admin admin] Request method failure captured: Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept: application/json Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept-Encoding: gzip, deflate Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Connection: keep-alive Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Content-Length: 0 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Host: 10.222.0.93 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-System-Scope: None Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: User-Agent: python-novaclient Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Auth-Token: gAAAAABi5-uojmpZ257KYGE1LyWNBwAIlILotzML644q42Ka8J3_i_L5VtZKC3y5TufNdvqoO3UHo8uI-RVudDXfizd4SREspecO_shgSgIT4ToLQy7fv9wp9MWNp42xxDeqcPSehPyDMMQFG73pHUeALarVx4z3rceQbUR33jmYcqMdKzZ_wZ4 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Id: None Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Name: None Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Identity-Status: Confirmed Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Is-Admin-Project: True Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Id: default Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Name: Default Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Name: admin Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Role: member,reader,admin Aug 01 15:05:13.322585 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Roles: member,reader,admin Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant: admin Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Name: admin Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User: admin Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Id: default Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Name: Default Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Name: admin Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: method: > Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: exception: Flavor 42 could not be found. Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: action_args: {'id': '42'} Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:13.324335 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:13.325587 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:13.327035 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-de524a90-1e81-4071-b6b5-33ecd83549b0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:13.328682 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-de524a90-1e81-4071-b6b5-33ecd83549b0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016455 Aug 01 15:05:13.328682 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 21/42] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Aug 1 15:05:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 15:05:14.326644 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-a028ecb9-f6b5-4c35-a170-3f3928a39179 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:14.327671 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-a028ecb9-f6b5-4c35-a170-3f3928a39179 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 01 15:05:14.328070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 22/43] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:14.911294 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-23e025fb-0c3b-4521-87dc-a79f61630e67 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:14.917440 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.wsgi [None req-23e025fb-0c3b-4521-87dc-a79f61630e67 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-23e025fb-0c3b-4521-87dc-a79f61630e67 admin admin] Request method failure captured: Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept: application/json Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept-Encoding: gzip, deflate Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Connection: keep-alive Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Content-Length: 0 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Host: 10.222.0.93 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-System-Scope: None Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: User-Agent: python-novaclient Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Auth-Token: gAAAAABi5-uqjeWjFbv_NSB_LzESJnXqEUdVKKMWu-o2K6ARWyNtVbm2WiZ61xthOjVtFgPSRp9I3j5GHjiq6Yny8G2tcvjUOOADY0MIcs1KDvfRKwOfp5UTL8Plhtu8MOaWXWHDuw-UDmHILWtnHfv_cBW9gWuHMqFW0s4cLhmS_f8QGBSC9w4 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Id: None Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Name: None Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Identity-Status: Confirmed Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Is-Admin-Project: True Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Id: default Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Name: Default Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Name: admin Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Role: member,reader,admin Aug 01 15:05:14.918979 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Roles: member,reader,admin Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant: admin Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Name: admin Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User: admin Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Id: default Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Name: Default Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Name: admin Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: method: > Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: exception: Flavor 84 could not be found. Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: action_args: {'id': '84'} Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:14.920556 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:14.921559 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.922942 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-23e025fb-0c3b-4521-87dc-a79f61630e67 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:14.924161 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-23e025fb-0c3b-4521-87dc-a79f61630e67 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.453880 Aug 01 15:05:14.924161 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 22/44] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Aug 1 15:05:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:05:14.930165 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-664c7a15-751a-4465-9abc-1b194a2cfba7 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:14.946153 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-664c7a15-751a-4465-9abc-1b194a2cfba7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019496 Aug 01 15:05:14.946739 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 23/45] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:14.956920 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-0f890835-a832-478f-8336-65894783475c admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:14.972822 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-0f890835-a832-478f-8336-65894783475c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019428 Aug 01 15:05:14.973379 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 23/46] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:14.983919 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-736afed8-7653-4169-a2c3-c834e94a60eb admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:14.989997 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.wsgi [None req-736afed8-7653-4169-a2c3-c834e94a60eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-736afed8-7653-4169-a2c3-c834e94a60eb admin admin] Request method failure captured: Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept: application/json Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept-Encoding: gzip, deflate Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Connection: keep-alive Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Content-Length: 0 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Host: 10.222.0.93 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-System-Scope: None Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: User-Agent: python-novaclient Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Auth-Token: gAAAAABi5-uqjeWjFbv_NSB_LzESJnXqEUdVKKMWu-o2K6ARWyNtVbm2WiZ61xthOjVtFgPSRp9I3j5GHjiq6Yny8G2tcvjUOOADY0MIcs1KDvfRKwOfp5UTL8Plhtu8MOaWXWHDuw-UDmHILWtnHfv_cBW9gWuHMqFW0s4cLhmS_f8QGBSC9w4 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Id: None Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Name: None Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Identity-Status: Confirmed Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Is-Admin-Project: True Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Id: default Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Name: Default Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Name: admin Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Role: member,reader,admin Aug 01 15:05:14.991778 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Roles: member,reader,admin Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant: admin Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Name: admin Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User: admin Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Id: default Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Name: Default Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Name: admin Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: method: > Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: exception: Flavor 84 could not be found. Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: action_args: {'id': '84'} Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:14.993411 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:14.994461 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:14.995818 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-736afed8-7653-4169-a2c3-c834e94a60eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:14.997317 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-736afed8-7653-4169-a2c3-c834e94a60eb admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012958 Aug 01 15:05:14.997317 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 24/47] 10.222.0.93 () {60 vars in 1190 bytes} [Mon Aug 1 15:05:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 15:05:15.985646 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-0f890835-a832-478f-8336-65894783475c admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:15.986675 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-0f890835-a832-478f-8336-65894783475c admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 01 15:05:15.987061 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 24/48] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:16.545640 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-5cbfdf57-8fda-4196-8de0-38ef7abba6aa admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:16.554880 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.wsgi [None req-5cbfdf57-8fda-4196-8de0-38ef7abba6aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-5cbfdf57-8fda-4196-8de0-38ef7abba6aa admin admin] Request method failure captured: Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept: application/json Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Accept-Encoding: gzip, deflate Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Connection: keep-alive Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Content-Length: 0 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Host: 10.222.0.93 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Openstack-System-Scope: None Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: User-Agent: python-novaclient Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Auth-Token: gAAAAABi5-urB4O-JBnziY_REPwAn2Yo_elJWD8ocW62QVdmRBS8lDPseoEm4X8YvE7Wl-PW1mNll8qMo99fJaI7NXDHyzmfpHlC_xH6oqeTuYWvrkAstH87obc7bbQtt-gN06lycH8qRcOoDZbLEYrE4e5K7AyURjUGT91eUylc-E3KcM6i7D0 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Id: None Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Domain-Name: None Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Identity-Status: Confirmed Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Is-Admin-Project: True Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Id: default Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Domain-Name: Default Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Project-Name: admin Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Role: member,reader,admin Aug 01 15:05:16.556432 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Roles: member,reader,admin Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant: admin Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-Tenant-Name: admin Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User: admin Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Id: default Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Domain-Name: Default Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: X-User-Name: admin Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: method: > Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: exception: Flavor 451 could not be found. Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: action_args: {'id': '451'} Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:16.558070 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:16.559055 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.560355 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-5cbfdf57-8fda-4196-8de0-38ef7abba6aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:16.561740 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-5cbfdf57-8fda-4196-8de0-38ef7abba6aa admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.429270 Aug 01 15:05:16.561740 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 25/49] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:05:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:05:16.567970 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-041b5bc6-1cf1-4996-9903-a59be91828f6 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:16.582958 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-041b5bc6-1cf1-4996-9903-a59be91828f6 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018543 Aug 01 15:05:16.583537 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 25/50] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:16.594081 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:16.610062 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019721 Aug 01 15:05:16.610622 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 26/51] 10.222.0.93 () {60 vars in 1210 bytes} [Mon Aug 1 15:05:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:05:16.620683 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-7f7af8a3-ded8-4e6a-aa0f-bbde6ade6e63 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:16.626201 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.wsgi [None req-7f7af8a3-ded8-4e6a-aa0f-bbde6ade6e63 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-7f7af8a3-ded8-4e6a-aa0f-bbde6ade6e63 admin admin] Request method failure captured: Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept: application/json Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Accept-Encoding: gzip, deflate Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Connection: keep-alive Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Content-Length: 0 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Host: 10.222.0.93 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-Api-Version: compute 2.90 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Openstack-System-Scope: None Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: User-Agent: python-novaclient Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Auth-Token: gAAAAABi5-urB4O-JBnziY_REPwAn2Yo_elJWD8ocW62QVdmRBS8lDPseoEm4X8YvE7Wl-PW1mNll8qMo99fJaI7NXDHyzmfpHlC_xH6oqeTuYWvrkAstH87obc7bbQtt-gN06lycH8qRcOoDZbLEYrE4e5K7AyURjUGT91eUylc-E3KcM6i7D0 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Id: None Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Domain-Name: None Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Identity-Status: Confirmed Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Is-Admin-Project: True Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Id: default Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Domain-Name: Default Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Project-Name: admin Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Role: member,reader,admin Aug 01 15:05:16.627738 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Roles: member,reader,admin Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_28ee187de5744709bb65431943eb0200", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/28ee187de5744709bb65431943eb0200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/28ee187de5744709bb65431943eb0200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant: admin Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Id: 28ee187de5744709bb65431943eb0200 Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-Tenant-Name: admin Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User: admin Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Id: default Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Domain-Name: Default Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Id: b035f76541b24134b8802d5327d7615c Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: X-User-Name: admin Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: method: > Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: exception: Flavor 451 could not be found. Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: action_args: {'id': '451'} Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:05:16.629328 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:16.630307 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: ERROR nova.api.openstack.wsgi Aug 01 15:05:16.631617 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-7f7af8a3-ded8-4e6a-aa0f-bbde6ade6e63 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:05:16.633020 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-7f7af8a3-ded8-4e6a-aa0f-bbde6ade6e63 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012123 Aug 01 15:05:16.633020 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 26/52] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:05:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 15:05:17.623613 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:17.625105 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Aug 01 15:05:17.625516 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 27/53] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:18.163246 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-ecee491a-5257-4ee3-9388-4357ba6b3a51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:05:18.182824 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-ecee491a-5257-4ee3-9388-4357ba6b3a51 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.415597 Aug 01 15:05:18.183366 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 27/54] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Aug 1 15:05:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:05:19.198348 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:19.199363 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 01 15:05:19.199838 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 28/55] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:19.806493 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-7fd1482c-5bbf-4a17-847b-1a8ef6bf0484 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:05:19.827761 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-7fd1482c-5bbf-4a17-847b-1a8ef6bf0484 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.486532 Aug 01 15:05:19.828322 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 28/56] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Aug 1 15:05:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:05:20.844540 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:20.845683 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 01 15:05:20.846098 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 29/57] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:21.510865 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-8aee3619-07c8-4c14-a8c4-3d88f7665159 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:05:21.531433 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-8aee3619-07c8-4c14-a8c4-3d88f7665159 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.544718 Aug 01 15:05:21.531973 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 29/58] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Aug 1 15:05:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:05:22.562966 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:22.563976 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 01 15:05:22.564371 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 30/59] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:05:23.175878 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-17516801-99b4-4da0-bd02-6f33bd1ef008 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:05:23.196782 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-17516801-99b4-4da0-bd02-6f33bd1ef008 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.491163 Aug 01 15:05:23.200509 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 30/60] 10.222.0.93 () {64 vars in 1235 bytes} [Mon Aug 1 15:05:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:05:24.212119 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:24.213270 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 01 15:05:24.213822 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 31/61] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:05:24.793630 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-2f3400eb-5572-4f82-97e1-e88eeba3c064 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:05:24.815498 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-2f3400eb-5572-4f82-97e1-e88eeba3c064 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.460327 Aug 01 15:05:24.816055 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 31/62] 10.222.0.93 () {60 vars in 1202 bytes} [Mon Aug 1 15:05:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:06:18.272305 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.273790 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-615be17a-11d9-432d-a961-4e2a0f8b02d3 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Aug 01 15:06:18.274263 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 32/63] 10.222.0.93 () {54 vars in 930 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:06:18.286011 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:18.753655 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-5a66f651-43ff-4108-b64e-b8ae20e497c2 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.792960 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-5a66f651-43ff-4108-b64e-b8ae20e497c2 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.510980 Aug 01 15:06:18.793956 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 32/64] 10.222.0.93 () {60 vars in 1291 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:06:18.816603 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG dbcounter [-] [103416] Writing DB stats nova_api:SELECT=14 {{(pid=103416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:06:18.821224 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-1cbd9366-807a-4f5e-b640-3220a36c3baf admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.831116 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-1cbd9366-807a-4f5e-b640-3220a36c3baf admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015936 Aug 01 15:06:18.831675 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 33/65] 10.222.0.93 () {60 vars in 1282 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:18.845324 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-d97dae9c-dec9-44f9-bc41-b53e22350857 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.854812 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-d97dae9c-dec9-44f9-bc41-b53e22350857 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013940 Aug 01 15:06:18.855376 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 33/66] 10.222.0.93 () {60 vars in 1285 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:18.868195 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.876922 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013122 Aug 01 15:06:18.877489 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 34/67] 10.222.0.93 () {60 vars in 1285 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:06:18.889874 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-c1a5f5eb-81b0-438e-b8e2-33aba821b765 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:06:18.897792 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-c1a5f5eb-81b0-438e-b8e2-33aba821b765 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011426 Aug 01 15:06:18.898340 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 34/68] 10.222.0.93 () {60 vars in 1282 bytes} [Mon Aug 1 15:06:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:10:13.179586 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:13.180705 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 01 15:10:13.181131 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 35/69] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:10:13.336595 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_api:SELECT=6 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:10:13.617819 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:13.621721 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:10:13.621721 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:10:13.623306 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:13.623807 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:13.625067 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:13.625615 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:13.691673 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-01e0edc8-48fa-4185-b947-5be3c0936fea admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.356636 Aug 01 15:10:13.692447 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 35/70] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:10:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:10:14.693692 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:14.695251 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001949 Aug 01 15:10:14.695931 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 36/71] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:10:14.934305 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:14.938821 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:10:14.938821 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:10:14.941282 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:14.942058 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:14.943486 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:14.944251 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:14.971231 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-8e235b96-a476-4166-ae37-d199dafdbf48 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.102576 Aug 01 15:10:14.971978 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 36/72] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:10:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:10:26.399229 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:26.400556 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Aug 01 15:10:26.401105 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 37/73] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:10:26.576529 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_cell0:SELECT=4 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:10:26.578374 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_cell1:SELECT=4 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:10:26.579426 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG dbcounter [-] [103415] Writing DB stats nova_api:SELECT=8 {{(pid=103415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:10:26.638221 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:26.641555 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:10:26.641555 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:10:26.643195 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:26.643717 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:26.644665 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:26.645180 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:26.674739 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-047d2774-bf9f-44eb-856b-ade38d8b7b04 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.106831 Aug 01 15:10:26.675363 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 37/74] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:10:26 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:10:27.793024 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: DEBUG nova.api.openstack.wsgi [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] Calling method '>' {{(pid=103416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:27.794948 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: INFO nova.api.openstack.requestlog [None req-7dc6ef8d-e956-4c19-8184-f97e4d13bc35 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002612 Aug 01 15:10:27.795662 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: [pid: 103416|app: 0|req: 38/75] 10.222.0.93 () {56 vars in 1074 bytes} [Mon Aug 1 15:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:10:28.165275 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG nova.api.openstack.wsgi [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] Calling method '>' {{(pid=103415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:10:28.168168 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 15:10:28.168168 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: warnings.warn(msg) Aug 01 15:10:28.169751 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:28.170240 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:28.171089 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:10:28.171560 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: DEBUG oslo_concurrency.lockutils [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:10:28.201347 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: INFO nova.api.openstack.requestlog [None req-f6012a54-8e56-4bdd-b3c6-42850ff01f0c admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.122041 Aug 01 15:10:28.202720 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: [pid: 103415|app: 0|req: 38/76] 10.222.0.93 () {60 vars in 1193 bytes} [Mon Aug 1 15:10:28 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:11:31.041422 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: Mon Aug 1 15:11:31 2022 - graceful shutdown triggered... Aug 01 15:11:31.042270 dv-cinder-803823-14-iscsi devstack@n-api.service[103415]: Gracefully killing worker 1 (pid: 103415)... Aug 01 15:11:31.042963 dv-cinder-803823-14-iscsi devstack@n-api.service[103416]: Gracefully killing worker 2 (pid: 103416)... Aug 01 15:11:31.047712 dv-cinder-803823-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 15:11:32.042618 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: worker 1 buried after 1 seconds Aug 01 15:11:32.042618 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: worker 2 buried after 1 seconds Aug 01 15:11:32.042618 dv-cinder-803823-14-iscsi devstack@n-api.service[103414]: goodbye to uWSGI. Aug 01 15:11:32.044410 dv-cinder-803823-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 15:11:32.045797 dv-cinder-803823-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 15:11:32.049870 dv-cinder-803823-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 15:11:32.061655 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 15:11:32 2022] *** Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: nodename: dv-cinder-803823-14-iscsi Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: machine: x86_64 Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: clock source: unix Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: pcre jit disabled Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: detected number of CPU cores: 4 Aug 01 15:11:32.064436 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: current working directory: / Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: detected binary path: /usr/bin/uwsgi-core Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: your processes number limit is 47680 Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: your memory page size is 4096 bytes Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: detected max file descriptor number: 2048 Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: lock engine: pthread robust mutexes Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: thunder lock: enabled Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 15:11:32.065601 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 15:11:32.110456 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: Python main interpreter initialized at 0x55f87714f9c0 Aug 01 15:11:32.110456 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: python threads support enabled Aug 01 15:11:32.110456 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: your server socket listen backlog is limited to 100 connections Aug 01 15:11:32.110456 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: your mercy for graceful operations on workers is 90 seconds Aug 01 15:11:32.111516 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 15:11:32.111516 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: *** Operational MODE: preforking *** Aug 01 15:11:32.111516 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: *** uWSGI is running in multiple interpreter mode *** Aug 01 15:11:32.111516 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: spawned uWSGI master process (pid: 117981) Aug 01 15:11:32.114971 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 1 (pid: 117992, cores: 1) Aug 01 15:11:32.114971 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: spawned uWSGI worker 2 (pid: 117993, cores: 1) Aug 01 15:11:32.114971 dv-cinder-803823-14-iscsi devstack@n-api.service[117981]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 15:11:32.111791 dv-cinder-803823-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 15:11:33.291546 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:11:33.348341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 15:11:34.674588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:11:34.674588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: from cryptography.utils import int_from_bytes Aug 01 15:11:34.675646 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:11:34.675646 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: from cryptography.utils import int_from_bytes Aug 01 15:11:35.217768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:11:35.217768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: from cryptography.utils import int_from_bytes Aug 01 15:11:35.218875 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 15:11:35.218875 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: from cryptography.utils import int_from_bytes Aug 01 15:11:38.353974 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:11:38.354701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:11:38.355310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:11:38.355906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:11:38.356348 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:11:38.357090 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.357678 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.358243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.358829 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.360305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.360305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.361315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.361453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.361926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.362393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.362971 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.363561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-14-iscsi {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.364151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.364998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.365554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.366131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.366682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.367273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.367811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.368720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.372503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.373855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.374849 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.375751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.376681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.377346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-14-iscsi {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.377865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.378655 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.379213 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.379935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.380536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.380998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.381514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.382087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.382625 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.383201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.383762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.384313 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.384972 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.385528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.386053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.386599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.387157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.387677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.388400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.389365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.389913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.390453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.390964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.391459 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.391863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.392281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.392866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.393436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.394000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.394549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.395220 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.395753 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.396268 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.396779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.397293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.397915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.398397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.398964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.399525 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.400067 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.400658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.401367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.401801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.402343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.402937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.403465 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.404010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.404939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.405234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.405679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.406158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.406642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.407145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.407686 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.408197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.408680 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.409223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.409924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.410352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.411210 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.413035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.413035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.413035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.413035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.413770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.414095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.414609 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.415164 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.415665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.416325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.416798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.417319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.417920 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.418519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.419049 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.419631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.420182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.420793 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.421385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.421993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.422497 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.423063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.423582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.424108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.424676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.425194 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.425734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.426491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.426863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.427463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.427934 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.428508 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.429065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.429608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.430168 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.430741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.431237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.431775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.432249 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.432811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.433263 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.433739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.434220 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.435885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.435885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.436393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.437750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.437750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.438093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.438645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.439288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.439877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.440453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.441303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.441488 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.442068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.442616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.443154 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.443826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.444308 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.445034 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.445456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.445935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.446398 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.446866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.447749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.448029 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.448662 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.449041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.449410 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.449782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.450143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.450471 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.450832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.451714 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.452511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.452511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.453040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.453300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.453562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.453834 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.454214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.454484 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.454739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.455044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.455381 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.455701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.456050 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.456456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.456886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.457206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.457656 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.457977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.458390 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.458760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.459073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.459436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.459728 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.460164 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.460422 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.460871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.461124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.461376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.461615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.461954 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.462717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.462717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.463211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.463211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.463690 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.463926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.464219 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.464736 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.465017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.465263 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.465518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.465776 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.466072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.466544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.466938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.467271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.467587 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.468003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.468241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.468704 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.468970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.469269 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.469611 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.469918 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.470360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.470608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.471327 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.471327 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.471794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.471794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.472252 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.472565 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.473281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.473281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.473746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.473746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.474227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.474482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.474756 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.475211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.475211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.475677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.475931 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.476571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.476922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.477362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.477735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.478199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.478530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.478901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.479233 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.479696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.480123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.480582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.480991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.481439 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.481862 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.482303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.483335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.483335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.483685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.484053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.484525 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.484900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.485345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.485728 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.486419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.486926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.487379 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.487849 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.488248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.488644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.489545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.489545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.496906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.498826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.500006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.501075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.501075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.501075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.501511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.501955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.502973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.502973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.503472 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.503889 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.504288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.504698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.505069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.505468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.505851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.507211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.507211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.507211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.507211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.508036 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.508196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.510751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.511106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.511490 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.511867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.512349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.516315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.518828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.518828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.518828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.518828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.518828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.519596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.519596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.519899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.520746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.521177 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.522764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.522764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.522764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.522764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.523454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.523454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.523740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.524050 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.524571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.527417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.528414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.528414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.528785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.528785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.529873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.530146 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.530429 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.531486 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.531486 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.531486 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.532225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.532225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.532752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.533019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.533285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.533744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.534017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.534270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.534527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.534774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.535183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.535511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.535826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.536140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.536455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.536864 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.537178 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.537486 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.537807 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.538122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.538426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.538847 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.539044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.539386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.540138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.540138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.540447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.540699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.541011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.541320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.541772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.542266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.543095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.543270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.543663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.543933 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 15:11:38.544790 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.544961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 15:11:38.545134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.545134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.545435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 15:11:38.545605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.545772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 15:11:38.545953 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.546114 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 15:11:38.546289 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.546448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.546597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.546761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.546761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.547019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.547171 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.547328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.547482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.547649 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.547800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.547960 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.548107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.548245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.548708 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.548949 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.549123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.549280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.549451 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.549609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.549800 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.550081 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.550280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.550616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.550785 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803823-14-iscsi {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.550950 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.551134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.551284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.551437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.551680 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.551867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.552035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.552208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.552751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.553079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.553265 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.553481 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.556380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.556699 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.556867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.557041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.557217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.557217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.557530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.557709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.557876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.558043 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.558199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.558350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.558518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.558700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.558866 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.559020 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.559190 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.559452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.559452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.559995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.560151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.560151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.561059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.561226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.561385 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.561551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.561718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.561874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.561874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.562196 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.562364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.562364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.562784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803823-14-iscsi {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.562948 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.562948 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.563261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.563261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.563567 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.563735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.563921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.563921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.565378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.565556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.565718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.565877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.566056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.566345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.566964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.566964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.567669 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.567851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.567851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.568163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.568316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.568316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.569253 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.569414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.569414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.569683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.569863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.570002 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.570153 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.570153 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.570418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.570564 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.570712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.570850 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.570997 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.571299 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.571445 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.571801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.572053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.572196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.572397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.572774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.573097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.573364 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.573613 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.577480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.577668 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.577827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.577827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.578104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.578370 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578370 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.578618 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578618 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578618 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.578862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.578987 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.579085 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.579551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.579658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.580038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.580159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.580941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.581074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.581607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.581724 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.581974 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.582118 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.582570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.583412 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.583556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.583661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.583753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.584030 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.584361 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.584693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.585248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.585956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.586079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.586433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.586783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.587069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.587276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.587611 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.588283 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.588393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.588893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.589054 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.589480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.589577 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.590084 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.590174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.590669 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.590817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.591630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.591768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.591938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.592122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.592551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.593160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.593325 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.593545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.593919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.594516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.594786 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.595101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.595616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.595713 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.596218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.596375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.596938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.597047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.597401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.597591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.598674 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.598792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.598891 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.598975 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.599356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.599457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.599924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.601988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.602239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602372 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.602462 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.602642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.602796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.602876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.603710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.603840 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.603927 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.604010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.604265 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.604597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.605148 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.605275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.605675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.605780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.606053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.606335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.606633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.607879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.608019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.608712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.609420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.609573 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.609690 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.609842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.610195 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.610414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.611060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.611254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.611656 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.611847 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.612260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.612422 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.612894 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.613481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.613655 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.614065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.614280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.614664 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.615255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.615405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.615538 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.615685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.615969 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.616074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.616576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.616758 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.617199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.617360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.617808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.618231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.618631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.618768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.619133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.619294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.619651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.619808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.620218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.620429 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.620832 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.621061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.621446 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.621653 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.622200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.622336 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.622416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.623453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.623566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.624043 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.624149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.624672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.624994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.625247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.625599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.625836 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.626181 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.626409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.626766 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.627009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.627286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.628362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.628608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.628608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.629088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.629739 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.629879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.629958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.630253 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.630437 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.630843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.630989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.631271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 15:11:38.631419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.631905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.632256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.632563 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.633198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.633685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.634013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.634494 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.634737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.635062 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.635245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.635577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.635712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.636076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.636204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.636715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.636875 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.637334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.637462 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.637938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.638119 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.638558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.638820 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.639428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.640211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.640320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.640452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.640622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.641078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.641179 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.641708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.641824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.642306 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.642449 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.642902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.642990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.643501 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.644099 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.644507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.645196 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.645348 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.645903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.646073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.646334 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.646434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.646899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.646987 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.651671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.651671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.652373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.652817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.652817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653402 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653706 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.653967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654137 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.654968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.655110 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.655280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.655403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.655748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.656107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.656431 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.656682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.657069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.657232 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.657645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.657813 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.658393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.658521 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.658862 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.659014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.659647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.659801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.660039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.660221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.660764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.661068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.661448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.661637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.661938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.662297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.662641 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.662978 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.663334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.663454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.663692 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.664016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.664120 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.664359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.664715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.664882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.665121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.665314 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.665483 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.665814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.665939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.666059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.666370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.666535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.666937 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.667237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.667566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.668004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.668345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.668694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.669025 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.669346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.670212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.670372 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.670938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.671289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.671539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.671757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.672169 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.672827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.673072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.673611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.673895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.674225 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.674499 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.674802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.675191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.675362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.675779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.676107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.676382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.676594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.677058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.677241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.677611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.677770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.678237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.678425 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.678810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.678987 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.679365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.679557 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.680806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681320 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681471 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681835 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.681997 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.682436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.682777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.683080 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.683333 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.683634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.683860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.684397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.684559 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.685079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.685986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687476 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.687983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.688086 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.688812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.688936 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.689044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.689586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.689692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.690165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.690263 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.690966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.691727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.691727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.691931 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.692016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.692658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.692795 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.693174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.693277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.693739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.693834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.695460 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.695671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.695771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.695868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.695964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.696052 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.696146 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.696304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.696584 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.696919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.697397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.697510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.697978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.698547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.700506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.700648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.700648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.701720 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.701831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.701912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.701912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.702216 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.705349 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.705566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.705737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.705895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.706049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.706221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.706403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.706610 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.706840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.707044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.707211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.707368 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.707765 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.707993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.708229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.708491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.708733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.708895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709415 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709415 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.709884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.710891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.711041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.711200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.711492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.711678 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.712023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.712496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.712688 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.713217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.713363 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.713811 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.713963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.714165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.714524 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.714852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.715094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.715747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.716014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.716259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.717103 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.717314 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.717481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.717888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.718060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.718507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.718694 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.718990 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.719245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.719632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.719821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.720084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.720243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.720721 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.720892 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.721093 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.721326 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.721570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.722058 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.722236 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.722687 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.722856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.723069 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.724082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.724247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.724406 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.724651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.724871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.725105 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.725597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.725783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.726174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.726510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.726765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.727135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.727356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.727744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.727943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.728335 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.728645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.729047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.729139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.729674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.729781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.730244 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.730350 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.730876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.730998 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.731720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.731835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.732104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.732203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.733349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.733698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.733936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.734202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.734202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.734403 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.734487 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.734840 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.735051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.735458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.735646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.736301 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.736956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.737639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.737816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.738401 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.738746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.738884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.739226 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.739739 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.740000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.740260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.740656 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.740903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.741180 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.741529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.741705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.742280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.742470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.746841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.747286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.747286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.747845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.748096 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.748356 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.748642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.748924 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.749174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.749424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.749672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.749919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.750204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.750451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.750700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.750945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.751202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.751202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.751202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.752439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.752745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.752995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.753237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.753477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.753761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.753999 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.754248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.754464 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.754700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.754938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.755169 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.755359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.755577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.755787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.756057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.756057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.756605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.756903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.757315 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.757542 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.757735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.757981 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.758142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.758292 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.758449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.758599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.758811 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759002 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759341 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.759962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.760121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.760279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.760436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.760646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.760890 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.761056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.761268 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.761461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.761628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.761993 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.762215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.762401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.762817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.762994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.764234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.764424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.764611 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.764840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.765192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.765375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.765780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.765976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.766884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.767085 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.767361 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.767694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.767861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.768061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.768247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.768406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.768752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.769350 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.769547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.769719 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.769920 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.770087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.770504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.770663 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.771086 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.771272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.771662 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.771862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.772238 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.772403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.773076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.773619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.773801 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.774076 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.774522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.774702 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.775003 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.775475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.775696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.776085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.777036 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.777390 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.777605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.777991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.779895 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.780210 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.780507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.780732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.780930 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.781157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.781406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.781630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.781787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.781938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782411 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782750 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.782977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.783174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.783380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.783550 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.784273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.784448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.784635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.784798 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.785204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.785488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.785803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.786032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.786421 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.786649 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.787149 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.787397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.787612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.787814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.788242 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.788653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.788873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.789208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.789457 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.789697 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.790529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.790783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.790783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.791208 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.791419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.791834 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.792060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.792431 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.792709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.793071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.793295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.793527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:11:38.793810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.794404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.795799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.795799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.798547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.798547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.798547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.798547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.799193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.799448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.800156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.800683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.801285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.801897 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.802543 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.803173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.803774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.804911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.805104 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.805611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.806193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.806797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.807518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.807993 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.808647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.809246 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.809848 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.810530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.811147 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.811754 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.812360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.814076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.814754 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.815346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.816000 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.816636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.817672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.817877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.821612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.822465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.822612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.824141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.824819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.825671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.826679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.827235 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.828017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.829145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.829145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.830180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.830180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.830180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.830700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.831164 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.831736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.832280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.833449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.833908 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.834401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.834838 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.835283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.835715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.836146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.837555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.837555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.837555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.838257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.838596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.839331 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.839883 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.840572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.841320 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.842409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.842829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.845427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.845427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.845427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.845928 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.846393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.847115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.847692 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.848309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.848951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.849472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.850027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.850593 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.851112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.851536 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.852219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.852370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.852901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.853460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.854045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.855522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.855522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.856366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.856628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.857325 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.858709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.858709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.859064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.859450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.859856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.860375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.861154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.861513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.861959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.862332 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.862935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.863653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.864007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.864619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.865165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.866638 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.866822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.868202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.868364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Registered counter for database nova_api Aug 01 15:11:38.868546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.868546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.869193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.869621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.870300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.870726 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.871384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.871845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.872428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.873111 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.873592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.874211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.874727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.875284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.875812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.876390 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.876965 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.877554 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.878263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.878751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.879289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.879844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.880527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.881155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.881523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.881994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.882445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.882944 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.883401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.883879 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.884696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.885436 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.885852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.886250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.886562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.886850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.888910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.888910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.888910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.888910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.889481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.889481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.889737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.889975 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.890519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.891011 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.891492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.892089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.892695 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.893024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.893393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.893803 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.894152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.894484 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.894805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.895106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:38.895297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.895586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.895827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.897142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.897142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.897142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.897522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.897664 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.898004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.898332 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.898667 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.899005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.899328 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.899657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.899982 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.900304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.900690 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.901007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.901512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.902089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.902458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.902785 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.903061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.903407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.904665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.904865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.905141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.905465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.905805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.906096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.906446 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.906781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.907718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.907718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.907952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.908149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.908412 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.908807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.909266 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.909589 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.909907 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.910241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.911015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.911015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.911337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.911484 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.911811 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.912199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.912627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.912945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.913217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.913538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.913917 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.914291 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.914555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.914876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.915237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.915524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.916105 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.916425 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.916771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:38.916935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.917121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.917453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.917779 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.918227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.918447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.918760 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.919078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.919515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.919763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.920507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.920507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.920843 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.921668 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.921668 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.921668 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.922338 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.922704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.923040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.923378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.923710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.924038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.924358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.924720 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.925039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.925352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.925978 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.925978 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.926293 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.926631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.926901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.927222 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.927537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.927854 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.928170 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.928558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.928891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.929167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.929479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.930005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.930570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.931134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.931705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.932275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.933009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.933652 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.933652 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.934216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.935042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.935694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.936282 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.936948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.937313 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.937812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.938376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.938979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.939571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.940180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.944749 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.945035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.946072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.946722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.947781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.948447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.949142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.949775 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.950400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.952409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.952409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.953001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.953362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.954039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.954543 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.955141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.955755 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.956353 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.956986 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.957564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.958152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.958744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.959328 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.959939 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.960614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.961202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.970555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.971240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.971867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.972519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.973134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.974032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.974459 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.974988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.975586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.976224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.976772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.977389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.978035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.978648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.979247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.980091 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.980744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.981686 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.981958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.983047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.983653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.984248 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.984895 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.985529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.986399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.987036 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.987648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.988778 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.989189 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.989439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.989802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.990406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.990953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.991378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.991715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.992154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.992390 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.992812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.993046 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.993407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.993723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.994382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.995362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.995362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.995648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.995803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.context [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9208223d-c65f-412b-8e82-b4c7b944694f(cell1) {{(pid=117993) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:11:38.995967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.996193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.996579 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.997118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.997881 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.998144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.998562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.998942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:38.999345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.000123 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.000275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.000664 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.001066 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.001527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.001921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.002231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.002586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.002973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.003345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.003708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.003856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:11:39.004518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.004518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.004919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.005216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.005548 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.006257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.006454 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.006651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.007041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.007433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.008547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:11:39.008744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.008744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.009102 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:11:39.009253 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.009581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.009948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.010413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.010793 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.011274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.011682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.012441 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.012441 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.012838 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.012979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:11:39.013130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.013404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.013736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.014066 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.014473 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.014738 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.015078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.015403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.015740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.016076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.016418 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Registered counter for database nova_cell0 Aug 01 15:11:39.016573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.016797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.017155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.017494 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.017864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.018203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.018717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 15:11:39.019267 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117992) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 15:11:39.023730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Registered counter for database nova_cell1 Aug 01 15:11:39.036307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.038756 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.048333 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.059021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.197058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO dbcounter [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Registered counter for database nova_api Aug 01 15:11:39.219464 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_db.sqlalchemy.engines [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.232551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writer thread running {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.295184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO dbcounter [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Registered counter for database nova_cell0 Aug 01 15:11:39.311073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_db.sqlalchemy.engines [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.325152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writer thread running {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.350781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.context [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9208223d-c65f-412b-8e82-b4c7b944694f(cell1) {{(pid=117992) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 15:11:39.359316 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:11:39.363024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:11:39.364769 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:11:39.368834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:11:39.373526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO dbcounter [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Registered counter for database nova_cell0 Aug 01 15:11:39.382021 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO dbcounter [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Registered counter for database nova_cell1 Aug 01 15:11:39.398744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_db.sqlalchemy.engines [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.399929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_db.sqlalchemy.engines [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.409591 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writer thread running {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.411660 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writer thread running {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.582902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO dbcounter [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Registered counter for database nova_cell0 Aug 01 15:11:39.591229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_db.sqlalchemy.engines [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 15:11:39.598467 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writer thread running {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 15:11:39.728212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:11:39.737894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:11:40.113962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: WARNING keystonemiddleware.auth_token [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:11:40.129241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: WARNING keystonemiddleware.auth_token [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:11:40.148628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:11:40.161190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: WARNING keystonemiddleware.auth_token [None req-10b75aed-9e94-4685-bb70-d0532cd37455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:11:40.171886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55f87714f9c0 pid: 117993 (default app) Aug 01 15:11:40.577828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: WARNING keystonemiddleware.auth_token [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 15:11:40.586149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: WARNING keystonemiddleware.auth_token [None req-1d32f8dc-0818-428a-96db-a816d700417c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 15:11:40.592941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55f87714f9c0 pid: 117992 (default app) Aug 01 15:12:34.365135 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:34.367192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:34.371209 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:34.374842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:36.517755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-06930d4f-f3cb-4779-8307-41c5d3809c33 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Action: 'create', calling method: .version_select at 0x7fc9ee927ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-566605077", "metadata": {"Type": "work"}}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:12:39.839114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-06930d4f-f3cb-4779-8307-41c5d3809c33 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 5.496579 Aug 01 15:12:39.852503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 1/1] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Aug 1 15:12:34 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 5503 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 15:12:39.886311 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:39.888766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:39.894674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:39.900058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:12:40.647317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fa3827df-f033-4b51-a47c-edb1121f1d08 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Calling method '.version_select at 0x7fc9ee954940>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:42.124882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fa3827df-f033-4b51-a47c-edb1121f1d08 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082" status: 200 len: 353 microversion: 2.1 time: 2.257895 Aug 01 15:12:42.129000 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 1/2] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:12:39 2022] GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 => generated 353 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:12:42.159023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f0880577-9cf2-4b05-b483-cff6cfacd7fb tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Calling method '.version_select at 0x7fc9ee7abd30>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:42.406273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f0880577-9cf2-4b05-b483-cff6cfacd7fb tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082" status: 200 len: 353 microversion: 2.1 time: 0.255011 Aug 01 15:12:42.407713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 2/3] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:12:42 2022] GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:12:42.450923 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e961e80c-1935-4643-87df-b60c6691dcf6 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Calling method '.version_select at 0x7fc9ee819d30>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:42.825177 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e961e80c-1935-4643-87df-b60c6691dcf6 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082" status: 202 len: 0 microversion: 2.1 time: 0.384048 Aug 01 15:12:42.826352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 2/4] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:12:42 2022] DELETE /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:12:42.841690 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c7b3af19-79a9-4018-ac1a-7613ef9303c2 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Calling method '.version_select at 0x7fc9ee7bc430>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:42.959752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c7b3af19-79a9-4018-ac1a-7613ef9303c2 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082" status: 200 len: 352 microversion: 2.1 time: 0.126746 Aug 01 15:12:42.962684 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 3/5] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:12:42 2022] GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:12:43.985115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e930a257-ef7f-4cff-9163-4df031d5ef02 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Calling method '.version_select at 0x7fc9ee7d5430>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:12:44.132371 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-e930a257-ef7f-4cff-9163-4df031d5ef02 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] HTTP exception thrown: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e930a257-ef7f-4cff-9163-4df031d5ef02 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Request method failure captured: Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 HTTP/1.1 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1i8_pC6fwqaOhrNVuAPrv3KwTSRdMGt5ZSLQj-CcXss1VuuScXIZqy6sJUpc00AP1-zUnIh19rKCVcxRbl6mRuQxfjObzJbBm4CZv0i09Y36IzQYUo4y3F3311363009eCdaIu5kxJdlyS_bz0BE7UfexMj5LyrpIt3Ppex_OQSr8 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 8d844e39eed04b248d2bc6a19d0f41a8 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesGetTestJSON-92136242 Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:12:44.140962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8d844e39eed04b248d2bc6a19d0f41a8", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d844e39eed04b248d2bc6a19d0f41a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8d844e39eed04b248d2bc6a19d0f41a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8d844e39eed04b248d2bc6a19d0f41a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesGetTestJSON-92136242 Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 8d844e39eed04b248d2bc6a19d0f41a8 Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesGetTestJSON-92136242 Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesGetTestJSON-92136242-project Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 81e09a5f4fd74f5586f221b5680b8e4c Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesGetTestJSON-92136242-project Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '73369f88-b36c-4bce-8018-fe286ac34082'} Aug 01 15:12:44.143202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. (HTTP 404) (Request-ID: req-c21a9fae-37fe-4ea3-b378-e9faa733ffaa) Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:12:44.144508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:12:44.146295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:12:44.150704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e930a257-ef7f-4cff-9163-4df031d5ef02 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] Returning 404 to user: Volume 73369f88-b36c-4bce-8018-fe286ac34082 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:12:44.156818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e930a257-ef7f-4cff-9163-4df031d5ef02 tempest-VolumesGetTestJSON-92136242 tempest-VolumesGetTestJSON-92136242-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082" status: 404 len: 109 microversion: 2.1 time: 0.164441 Aug 01 15:12:44.160684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 3/6] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:12:43 2022] GET /compute/v2.1/os-volumes/73369f88-b36c-4bce-8018-fe286ac34082 => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:13:01.464607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-37d6b1b1-094f-452c-8742-b219aa42fd6f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: .version_select at 0x7fc9ee7bca60>, body: {"keypair": {"name": "tempest-keypair-406286181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTdzaECeMdUx6DIeyWOIk2M75eoyoCJPGpYu5ap1InR0QB7A8Dh3KwTqqBMaOsGPD855TcTume3xjFIRuDJCsB9fq9bDsP+/OtDFOUS4zZElSn9SYZSpdFbHEU+rvMScw=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:01.704722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-37d6b1b1-094f-452c-8742-b219aa42fd6f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for project 8b18759847b44a698a092e4484b244d0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:01.725551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-37d6b1b1-094f-452c-8742-b219aa42fd6f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for user 3c18437883ce42369c7563224c208523 and project 8b18759847b44a698a092e4484b244d0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:01.848884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-37d6b1b1-094f-452c-8742-b219aa42fd6f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.898175 Aug 01 15:13:01.850143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 4/7] 10.222.0.93 () {62 vars in 1200 bytes} [Mon Aug 1 15:13:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 900 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:13:04.674616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1893981040", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:04.817937 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5e788cda-489e-4842-9969-859f57de326f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: .version_select at 0x7fc9ee73b3a0>, body: {"keypair": {"name": "tempest-keypair-59681120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8K6r1uG9kUvEGVgg7tTE/Lm1KrB4sV2WseihrCY6QRf/l8WKJA/dzSldgmSO+OjAgKkkUNgwCaJIx5s5G0HzIYwEdZlWMOswzc5WWh8nawfykLs/ZRWgSzOqGPOnmkvg=="}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:05.082368 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-5e788cda-489e-4842-9969-859f57de326f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for project 916870664da8419eb5466fd75b15987d. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:05.103351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-5e788cda-489e-4842-9969-859f57de326f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for user 5a49850f6d8a474d83821f5f49dff06c and project 916870664da8419eb5466fd75b15987d. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:05.123750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] validate_networks() for [('293a9d7f-74cf-4225-a1b0-44acc0b59f1f', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:13:05.331589 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5e788cda-489e-4842-9969-859f57de326f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 2.141421 Aug 01 15:13:05.332809 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 4/8] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:13:03 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:11.674221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:13:11.675030 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:13:11.675962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:13:11.679367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:13:11.680282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:13:11.746961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:11.748054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:11.749815 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:11.757358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:11.896411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:11.906614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for user 3af3a5c1c2f94e51bee936b4762dc14c and project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:11.957230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:13:11.985328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:13:12.330114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5a311530-c4eb-41bb-aeb6-be3a918a0447 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 9.024164 Aug 01 15:13:12.334204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 5/9] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:13:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 9032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:13:12.364328 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4aaf1ab8-1a75-47d9-98e6-9690e1f51fa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:12.367024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4aaf1ab8-1a75-47d9-98e6-9690e1f51fa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:12.891053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4aaf1ab8-1a75-47d9-98e6-9690e1f51fa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:12.962112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4aaf1ab8-1a75-47d9-98e6-9690e1f51fa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1222 microversion: 2.1 time: 0.610594 Aug 01 15:13:12.977901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 5/10] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:12 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1222 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:13.795440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1352821499", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:14.077427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] validate_networks() for [('293a9d7f-74cf-4225-a1b0-44acc0b59f1f', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:13:15.263174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1152732788", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "networks": [{"uuid": "702816a1-d9fb-4576-b5f0-827f10f91c87"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:15.719643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] validate_networks() for [('702816a1-d9fb-4576-b5f0-827f10f91c87', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:13:17.669785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:13:17.670754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:13:17.671383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:13:17.672028 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:13:17.672685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:13:17.711738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:17.714282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:17.719606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:17.724812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:17.829990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:17.871335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for user 3af3a5c1c2f94e51bee936b4762dc14c and project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:17.942530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:13:17.946832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:13:18.180612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fc75d7ab-e687-42fe-8f89-6a87f9eb58b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.391361 Aug 01 15:13:18.184279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 6/11] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:13:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 4396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:13:18.207458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1303109680", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03f2f7b6-6696-4300-b786-a55a2c829f71"}], "security_groups": [{"name": "tempest-securitygroup--1085484388"}], "key_name": "tempest-keypair-406286181", "user_data": "}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:19.312202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] validate_networks() for [('03f2f7b6-6696-4300-b786-a55a2c829f71', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:13:20.587061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:13:20.589178 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:13:20.590197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:13:20.591076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:13:20.591829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:13:20.663632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:20.664354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:20.666026 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:20.667345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:20.798308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Getting quotas for project 51e95123daab4cd285589cb523685623. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:20.822384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Getting quotas for user e708da2136a248c196ae4ecb531bb322 and project 51e95123daab4cd285589cb523685623. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:20.890517 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:13:20.897044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:13:21.286008 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e996f035-cd8d-4c54-8a39-b43d39cf011f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.363582 Aug 01 15:13:21.287277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 6/12] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:13:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 7367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:13:21.327316 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-705898b9-f6de-4f78-b563-be4e85197d7a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:21.329027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-705898b9-f6de-4f78-b563-be4e85197d7a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:22.356791 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-705898b9-f6de-4f78-b563-be4e85197d7a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:22.426757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-705898b9-f6de-4f78-b563-be4e85197d7a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1222 microversion: 2.1 time: 1.120688 Aug 01 15:13:22.438167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 7/13] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:21 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1222 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:22.514960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1066645851", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11e15496-1f56-46e5-b6a2-dabb8c5f6af3"}], "security_groups": [{"name": "tempest-securitygroup--1316148419"}], "key_name": "tempest-keypair-59681120", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:22.691612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:13:22.700780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:13:22.702785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:13:22.708842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:13:22.710575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:13:22.806482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:22.812963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:22.818869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:22.839121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:23.024939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for project 8b18759847b44a698a092e4484b244d0. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:23.057702 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for user 3c18437883ce42369c7563224c208523 and project 8b18759847b44a698a092e4484b244d0. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:23.235498 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:13:23.264023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:13:23.642165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e13c4035-5335-4747-a6e3-750daf57855b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.453537 Aug 01 15:13:23.648846 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 7/14] 10.222.0.93 () {62 vars in 1188 bytes} [Mon Aug 1 15:13:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 5463 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 15:13:23.689156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9341482b-dab9-4c54-9dc0-ca6b56309505 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:23.692501 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9341482b-dab9-4c54-9dc0-ca6b56309505 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:23.811321 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] validate_networks() for [('11e15496-1f56-46e5-b6a2-dabb8c5f6af3', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:13:24.139350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9341482b-dab9-4c54-9dc0-ca6b56309505 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:24.179435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9341482b-dab9-4c54-9dc0-ca6b56309505 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1215 microversion: 2.1 time: 0.526449 Aug 01 15:13:24.184190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 8/15] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:23 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1215 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:24.202398 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:24.210504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:24.231250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:24.231762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:24.233286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:24.234492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:24.966745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:25.058311 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-783088fc-13f1-4317-8e2a-cd61614fa607 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1274 microversion: 2.1 time: 0.872256 Aug 01 15:13:25.059369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 9/16] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:24 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1274 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:25.091339 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:25.107998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:25.374862 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:25.406781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:25.411824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:25.417163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-76db4bc3-4e83-4c04-bb5f-c50699a26ace tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1281 microversion: 2.20 time: 0.353951 Aug 01 15:13:25.423235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 10/17] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:25 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:25.446720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:25.452156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:25.470201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:25.471032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:25.474052 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:25.475708 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:25.678357 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:25.712979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-004e53ee-abd0-482b-9a8c-e48f7f8b9411 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1219 microversion: 2.1 time: 0.280005 Aug 01 15:13:25.715143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 11/18] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:25 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1219 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:26.108185 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:26.110939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:26.124198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.137365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.139458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.140754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.331254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:26.349560 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:13:26.351465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:13:26.354452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:13:26.363530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fcbdaa30-db01-4ee3-989d-00f8147dec7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1274 microversion: 2.1 time: 0.261881 Aug 01 15:13:26.373975 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:13:26.392824 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:13:26.393394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 12/19] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:26 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:26.460281 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.461809 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.464957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.466088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:26.466764 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.474244 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:26.509471 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.510786 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.514754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.522047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.584304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for project 916870664da8419eb5466fd75b15987d. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:13:26.654701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for user 5a49850f6d8a474d83821f5f49dff06c and project 916870664da8419eb5466fd75b15987d. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:13:26.761375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:13:26.773912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:13:26.794794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:26.849670 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:26.865466 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:26.873037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-59338164-d33c-4aef-9689-454479948468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1285 microversion: 2.20 time: 0.417234 Aug 01 15:13:26.875763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 13/20] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:26 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1285 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:13:26.895377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:26.899874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:26.951454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.957168 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:26.959861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:26.964844 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:27.108610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b1070671-4184-4ebf-99cd-63a5f3eb5e11 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.662354 Aug 01 15:13:27.125732 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 8/21] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:13:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 4687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:13:27.152009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a3125011-8f50-41de-b616-3f84ee101607 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:27.155063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a3125011-8f50-41de-b616-3f84ee101607 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:27.515274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a3125011-8f50-41de-b616-3f84ee101607 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:27.567708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a3125011-8f50-41de-b616-3f84ee101607 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1236 microversion: 2.1 time: 0.414062 Aug 01 15:13:27.587089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 9/22] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:27 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1236 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:27.642927 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:27.650541 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:27.685728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:27.694362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:27.704786 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:27.750554 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:28.413018 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:28.459420 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-abb0778d-70c8-487d-a89c-d6ea28c1da6d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1219 microversion: 2.1 time: 1.576741 Aug 01 15:13:28.460419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 14/23] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:26 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1219 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:28.489375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:28.492808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:28.542554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:28.549593 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:28.552534 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:28.553281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:29.253914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.319644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b13f1bda-8c58-4c8c-bcf7-38ac5f5aa295 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1280 microversion: 2.1 time: 1.723709 Aug 01 15:13:29.324852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 10/24] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:27 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1280 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:29.372837 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ae86389a-9a24-4cfc-b17d-c7c4a0e40266 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:29.377260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ae86389a-9a24-4cfc-b17d-c7c4a0e40266 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:29.394963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.449410 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.465339 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.467730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-53b40de5-a0d4-4c81-8b28-d16c459c4212 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1277 microversion: 2.20 time: 1.005363 Aug 01 15:13:29.512144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 15/25] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:28 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1277 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:29.531895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:29.537704 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:29.566364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:29.570366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:29.580187 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:29.581852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:29.594909 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ae86389a-9a24-4cfc-b17d-c7c4a0e40266 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.624165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ae86389a-9a24-4cfc-b17d-c7c4a0e40266 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1236 microversion: 2.1 time: 0.291872 Aug 01 15:13:29.625870 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 11/26] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:29 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1236 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:29.831108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:29.843465 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aeeb1240-ba3f-4ae1-92ce-cbe79dfe1f96 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 0.327464 Aug 01 15:13:29.845964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 16/27] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:29 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:30.276450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-fff8450a-a862-44a2-8106-8a3c9a40494c req-9af73c9f-1cad-4983-b2a6-c4d3bdcb30a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a4af5a-02a1-4627-b6cf-6d04fa59a5ee", "tag": "1a839c00-ef8e-4234-8be0-c00f74498522"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:30.297393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-fff8450a-a862-44a2-8106-8a3c9a40494c req-9af73c9f-1cad-4983-b2a6-c4d3bdcb30a2 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.298309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-fff8450a-a862-44a2-8106-8a3c9a40494c req-9af73c9f-1cad-4983-b2a6-c4d3bdcb30a2 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.335614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-fff8450a-a862-44a2-8106-8a3c9a40494c req-9af73c9f-1cad-4983-b2a6-c4d3bdcb30a2 service nova] Creating event network-changed:1a839c00-ef8e-4234-8be0-c00f74498522 for instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee on hv-cinder-80382 Aug 01 15:13:30.336317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-fff8450a-a862-44a2-8106-8a3c9a40494c req-9af73c9f-1cad-4983-b2a6-c4d3bdcb30a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:13:30.337679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.339084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.340227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.342050 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.361880 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:30.362504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:30.379012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.compute.rpcapi [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:13:30.380205 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] Releasing lock "compute-rpcapi-router" {{(pid=117992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:13:30.380967 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.381937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.389798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.390835 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.433218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b760d576-2524-4d1f-8486-6ede0b7ebb36 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270813 Aug 01 15:13:30.433961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 12/28] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:30.518426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:30.519337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:30.549485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.550202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.551188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.551716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.671716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:30.693769 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5eb2d350-a5cc-4e9d-8ca7-31b188c02c0f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1280 microversion: 2.1 time: 0.335726 Aug 01 15:13:30.695548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 17/29] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:30 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:30.703108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:30.704246 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:30.713584 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.714946 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.718230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.719507 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.750352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:30.766358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:30.768865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:30.770061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-eea0d68b-999e-4801-a376-58919a2b5d30 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1333 microversion: 2.20 time: 0.259015 Aug 01 15:13:30.785855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 13/30] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:30 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1333 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:30.877617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:30.878814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:30.888346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:30.894391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.900167 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0e993c9f-bca5-4535-b7e3-f73fbd6d4017 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1240 microversion: 2.1 time: 0.202773 Aug 01 15:13:30.912821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:30.912821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:30.913087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 18/31] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:30 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1240 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:30.913206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.107704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:31.127774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e53f5383-9f61-4b77-afbc-5894b35361d5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 0.255544 Aug 01 15:13:31.137017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 14/32] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:30 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:31.735190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:31.738343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:31.742357 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:31.758227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.759374 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.761768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.762864 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.815019 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:31.818383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:31.831331 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.832023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.833015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.833827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.925426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:31.942872 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:31.945312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:31.946874 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6df6779d-de68-4698-bca3-11d4548df6bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1333 microversion: 2.20 time: 0.140611 Aug 01 15:13:31.951454 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 15/33] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:31 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1333 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:31.963991 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:31.965194 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:31.977448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.978039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:31.979699 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:31.980254 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:32.076120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:32.077163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:32.090643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bd7a9318-d0b3-4e38-bcfb-cc9fafdd9a8b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1240 microversion: 2.1 time: 0.139905 Aug 01 15:13:32.090975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-34be4935-7796-45c5-8905-11d5716145c4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.366597 Aug 01 15:13:32.091960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 16/34] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:31 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1240 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:32.095757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 19/35] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:31 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:32.159485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:32.160133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:32.170637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:32.171326 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:32.172911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:32.173748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:32.318388 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:32.343593 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1b1688d1-9171-4d6f-81d0-735b30b611d7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 0.187663 Aug 01 15:13:32.344530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 17/36] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:32 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:32.990290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:32.992455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:33.002722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:33.006415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.007628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.009380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.010975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.164788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:33.171168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:33.217564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:33.226503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.227767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.229513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.232052 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.233486 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.282777 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.294427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.302145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-386a82fa-0161-4471-bc77-cec55ac38480 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1333 microversion: 2.20 time: 0.318182 Aug 01 15:13:33.306187 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 20/37] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:32 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:33.379676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:33.380664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:33.437958 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.438877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.439065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.439743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.440199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.463661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a81060c1-1dfb-4fb5-b178-e59be95de521 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1240 microversion: 2.1 time: 0.339075 Aug 01 15:13:33.470400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 18/38] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:33 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1240 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:33.491179 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:33.494622 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:33.527577 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.531913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.533851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:33.539566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:33.667326 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.688014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b3fff93f-7e92-4576-9626-8e7674189711 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 0.214482 Aug 01 15:13:33.690521 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 19/39] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:33 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:33.741191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:33.760570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0b0fc475-0e60-40b2-90fc-ebd87b9c5ec6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.446049 Aug 01 15:13:33.760570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 21/40] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:33 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:34.355141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:34.356051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:34.365004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.365684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.367986 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.368654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.492762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:34.493386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:34.502185 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.502743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.503629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.504548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.544351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:34.564366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:34.568375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:34.570968 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-af3afe5f-46d2-4bab-84e0-4b4311c1c1bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1333 microversion: 2.20 time: 0.221366 Aug 01 15:13:34.585970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:34 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1333 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:34.610675 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:34.624919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-56ff24a6-8987-4cc4-a409-ade6a63f5670 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1240 microversion: 2.1 time: 0.136974 Aug 01 15:13:34.627072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 22/42] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:34 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:34.726045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:34.727237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:34.736040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.736558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.737485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.738070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.801742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:34.803135 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:34.818793 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.820581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.824132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:34.825309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:34.871771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:34.898532 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7921c38a-f2d2-46b8-abc5-142f85fa79a6 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 0.177094 Aug 01 15:13:34.909421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 21/43] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:34 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:35.063661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:35.080029 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-80870ef9-439e-487e-a3d7-35e763b67125 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.292710 Aug 01 15:13:35.081059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 23/44] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:34 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:35.608564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:35.611683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:35.635199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:35.636006 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:35.637531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:35.638585 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:35.660195 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:35.661658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:35.680266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=26 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:35.687644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:35.689108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:35.691774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:35.693064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:35.848717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:35.875156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:35.884566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:35.888106 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2782aea7-1d2c-43d7-a1e9-1d63893682bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1333 microversion: 2.20 time: 0.286854 Aug 01 15:13:35.907432 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:35 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1333 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:35.954679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:35.955891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:35.957143 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:36.005641 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:36.006717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:36.007285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-23827d42-d872-4823-ae70-d24dfa4db139 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1240 microversion: 2.1 time: 0.356303 Aug 01 15:13:36.008270 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:36.013302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:36.031251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 24/46] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:35 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1240 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:36.127929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:36.136916 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:36.194436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:36.197300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:36.207035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:36.212457 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:36.412725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:37.785681 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:37.842871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4a6f0cfa-c8b2-43f2-92d7-0d380c88bd22 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1267 microversion: 2.1 time: 1.899095 Aug 01 15:13:37.844090 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 23/47] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:35 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1267 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:37.873086 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:37.874310 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:37.891768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:37.893360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:37.897339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:37.898727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:38.187057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:38.226344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ad251c59-cea9-46ab-ae68-223d69124a0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 2.112962 Aug 01 15:13:38.230514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 25/48] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:36 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 2118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:38.249529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:38.259106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:38.317689 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:38.319888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:38.324821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:38.327773 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:38.703708 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:38.736371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4a7d05f-e6ec-46d2-9f7e-9512792fdafc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1296 microversion: 2.1 time: 0.503357 Aug 01 15:13:38.742400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 26/49] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:38 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1296 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:38.891963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:38.892616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:38.909095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:38.909555 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:38.915732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:38.918997 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:39.153667 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:39.182589 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:39.190174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:39.194063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4e817c8c-36be-4c18-a49d-b020aabe9b4b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1339 microversion: 2.20 time: 1.346581 Aug 01 15:13:39.195446 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 24/50] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:37 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1339 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:39.296970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:39.300702 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:39.340658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:39.354084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:39.356759 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:39.363683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:39.537988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:39.554379 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-eca63e69-a766-4d90-8d2d-3f224cedc436 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1273 microversion: 2.1 time: 0.667236 Aug 01 15:13:39.559085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 27/51] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:38 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1273 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:39.614046 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=24 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:39.813235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:39.816401 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:39.863936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:39.864726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:39.866296 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:39.867073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:40.274377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:40.298603 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d10e2d8c-9c9c-4199-a848-d301e3684f7b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 1.031976 Aug 01 15:13:40.299568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 25/52] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:39 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:40.323730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:40.334896 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:40.336077 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:40.347777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:40.348613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:40.351492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:40.352910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:40.360549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c295fd1f-15a9-4220-85a4-39ef4dd01b34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1294 microversion: 2.1 time: 0.584214 Aug 01 15:13:40.369240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 28/53] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:39 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1294 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:40.438653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:40.621983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:40.623290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:40.673392 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:40.674998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:40.677083 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:40.678151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:40.890244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:40.932581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:40.937612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:40.945509 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7c6fdc4b-10ac-44ee-aa4e-f4bd0b6a8add tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1339 microversion: 2.20 time: 0.625897 Aug 01 15:13:40.947761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 26/54] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:40 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1339 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:41.149363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:41.175760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9b63d76c-0706-43fc-bca1-79294bc66dae tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1273 microversion: 2.1 time: 0.580546 Aug 01 15:13:41.190762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 29/55] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:40 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1273 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:41.343078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:41.351283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:41.411657 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:41.413397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:41.416733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.418133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.424631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.434144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.459829 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.465108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.474166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:41.475735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:41.589865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:42.073568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:42.105091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8d6568e7-6e35-40be-8401-281fe52ebb89 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1294 microversion: 2.1 time: 0.698555 Aug 01 15:13:42.122514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 30/56] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:41 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1294 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:42.544922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-215a934d-f4ea-43a1-994b-33b2bb7444c1 req-7bfb55fc-d526-48ca-8108-3dd624721cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af7cd8a-b958-4f36-97eb-54d514cd3989", "tag": "16fdef4d-62ea-4f57-8f5b-39a4f91caec2"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:42.622247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-215a934d-f4ea-43a1-994b-33b2bb7444c1 req-7bfb55fc-d526-48ca-8108-3dd624721cb7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:42.629951 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-215a934d-f4ea-43a1-994b-33b2bb7444c1 req-7bfb55fc-d526-48ca-8108-3dd624721cb7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:42.817145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-215a934d-f4ea-43a1-994b-33b2bb7444c1 req-7bfb55fc-d526-48ca-8108-3dd624721cb7 service nova] Creating event network-changed:16fdef4d-62ea-4f57-8f5b-39a4f91caec2 for instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 on hv-cinder-80382 Aug 01 15:13:42.822834 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-215a934d-f4ea-43a1-994b-33b2bb7444c1 req-7bfb55fc-d526-48ca-8108-3dd624721cb7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 15:13:42.831077 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:42.831868 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:42.833512 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:42.834395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:42.881852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.compute.rpcapi [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 15:13:42.882727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] Releasing lock "compute-rpcapi-router" {{(pid=117993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 15:13:42.975251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f1400aea-ef25-41db-bf29-f30095f3fa19 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.850163 Aug 01 15:13:42.976927 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 31/57] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:42.998131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:43.002255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:43.031045 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.033308 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:43.038352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.039696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:43.325977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:43.363913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:43.366455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:43.368151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-900dbcc1-e6e0-4b96-9484-0b8b6771d698 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1339 microversion: 2.20 time: 0.388515 Aug 01 15:13:43.369366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 32/58] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:42 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1339 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:43.376233 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:43.377362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:43.386428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.387344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:43.388790 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.389446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:43.565127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:43.591516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f01b0795-58fa-48a3-bc2f-b02ef6df618e tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1273 microversion: 2.1 time: 0.218861 Aug 01 15:13:43.593235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 33/59] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:43 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:43.638629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:43.646530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:43.669567 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.679615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:43.686022 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:43.687294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:44.413226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:44.445106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-528dd966-da6c-46c2-8161-63453db2c12e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1294 microversion: 2.1 time: 0.850661 Aug 01 15:13:44.453428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 34/60] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:43 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1294 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:44.475692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:44.508677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:44.548493 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:44.552593 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:44.557482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:44.563002 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:44.784664 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:44.809002 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2b1fb0d1-f980-42ef-838a-2426bf44a4cb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 3.474427 Aug 01 15:13:44.818403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 27/61] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:41 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 3485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:44.846843 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:44.849134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:44.918017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:44.919842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:44.922036 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:44.925001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:45.257227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:45.330936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:45.340585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:45.343503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f07a1f87-16f2-44cb-bf19-489879f88427 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1339 microversion: 2.20 time: 0.884519 Aug 01 15:13:45.350023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 35/62] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:44 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1339 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:45.354765 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:45.409146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-beb34aaa-b3c5-4dae-b75e-76b76b1cabdf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1273 microversion: 2.1 time: 0.588704 Aug 01 15:13:45.412140 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 28/63] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:44 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:45.504787 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:45.506928 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:45.550647 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:45.557068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:45.558727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:45.559548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:45.838704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:45.839669 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:45.901749 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:45.902561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:45.903956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:45.926959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:46.532592 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:46.553138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-92ef6108-68f2-409e-9c8a-7e7b53821913 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1294 microversion: 2.1 time: 1.055034 Aug 01 15:13:46.554457 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 36/64] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:45 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1294 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:46.566095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:46.567573 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:46.581693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:46.583782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:46.586031 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:46.589959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:46.733006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:46.746484 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:46.750925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:46.753222 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7304c60a-8c2b-4eb1-85eb-4f9d2d57a36d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1339 microversion: 2.20 time: 0.196508 Aug 01 15:13:46.769248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 37/65] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:46 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:46.789402 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:46.791272 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:46.815290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:46.816603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:46.817854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:46.818551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:47.128264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:47.144163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3da1d6ed-54d3-46a8-8a2c-da5bd4b69654 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.372681 Aug 01 15:13:47.145264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 38/66] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:46 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:47.429728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:47.457095 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bf0ebebd-d343-410e-a89a-506d0116797a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 1.625126 Aug 01 15:13:47.459656 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 29/67] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:45 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:47.587403 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:47.589642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:47.615150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:47.619589 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:47.628344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:47.629652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:47.801130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:47.802670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:47.822000 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:47.828384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:47.830072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:47.833663 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:47.858644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:47.878566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8e2b98b4-5565-430c-bf77-52f450cdfd57 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1294 microversion: 2.1 time: 0.297399 Aug 01 15:13:47.880018 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 39/68] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:47 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1294 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:48.191000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:48.193635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:48.227859 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.233742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:48.236029 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.239358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:48.303793 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:48.318972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:48.322084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:48.325358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-70921800-244a-4ab2-b52d-9e63fd7f2430 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.531790 Aug 01 15:13:48.326213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 30/69] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:47 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:13:48.511087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:48.512417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:48.527144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.527462 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:48.527647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:48.528399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.528904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:48.543375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-10cb2ea4-49e1-4662-beb0-0141125efceb tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.365509 Aug 01 15:13:48.545448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 40/70] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:48 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:48.764740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:48.777990 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8ffb0fdf-b2c8-4d9c-b8c3-f6e5c0aca255 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.272893 Aug 01 15:13:48.779157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 31/71] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:48 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:48.922749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:48.923543 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:48.931478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.931933 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:48.932811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:48.933247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.126041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:49.140061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ea44443d-4f5a-403b-9a64-828597f772d6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.221824 Aug 01 15:13:49.141177 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 41/72] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:48 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:49.361569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:49.362126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:49.370399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.371070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.372292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.373062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.542767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:49.558010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:49.561135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:49.563218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e76e4264-b8d8-40ce-8e31-34d8320f25a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.206732 Aug 01 15:13:49.564275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 32/73] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:49 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:49.579851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:49.580620 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:49.588107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.588709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.589575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.590012 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.610965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:49.751026 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:49.767070 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7cf6f48d-fbb2-4b49-bdd3-4b6cbae30011 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.190624 Aug 01 15:13:49.768149 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 42/74] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:49 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:49.817620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:49.818464 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:49.826980 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.827489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:49.828332 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:49.828897 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.007455 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:50.018382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2168c091-500f-45d7-a997-417d1dabd512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.206641 Aug 01 15:13:50.019259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 33/75] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:49 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:50.175960 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:50.176684 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:50.183554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.183917 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.184838 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.185279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.370350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:50.379886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-93db6c8a-2510-42ae-bb0c-d4565686cae0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.208704 Aug 01 15:13:50.380941 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 43/76] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:50 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:50.602524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:50.603646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:50.612409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.613033 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.613931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.614474 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.773914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:50.782867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:50.784420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:50.785711 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a5555fa0-3cb5-4fea-9c8c-8456b07721ab tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.188093 Aug 01 15:13:50.786297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 34/77] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:50 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:50.793520 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:50.794443 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:50.801335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.801902 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:50.802767 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:50.803271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.003467 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:51.013939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6c580134-3f1c-4a1c-8335-ed9c77fc7c0b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.225429 Aug 01 15:13:51.014667 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 44/78] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:50 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:51.042779 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:51.043421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:51.055214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.055787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.057465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.057878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.272227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:51.288308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-be7e03cc-8699-4d5e-9c5e-671ab450d24d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.250265 Aug 01 15:13:51.291438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 35/79] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:51 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:51.419926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:51.421723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:51.440256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.443969 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.445771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.702291 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:51.713557 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bdb4c900-7718-40c8-808f-c8d7986101d7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.300694 Aug 01 15:13:51.714163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 45/80] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:51 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:51.827880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:51.828567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:51.856828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.859115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:51.860748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:51.861867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.051662 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:52.053928 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:52.068926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.069886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.071411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.071978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.382320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:52.391642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-141a38d1-0455-4414-b7da-aae3ed47100c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.348819 Aug 01 15:13:52.392768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 46/81] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:52 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:52.410106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:52.410721 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:52.419038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.419467 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.420250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.421540 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.624238 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:52.643215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2f0bc9bd-c730-474b-b0e0-0996ad96dd64 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.249252 Aug 01 15:13:52.644746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 47/82] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:52 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:52.739935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:52.740637 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:52.749139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.751303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.752490 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:52.753527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:52.772722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:52.785629 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:52.791094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:52.800087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9d54f37a-291e-43d1-9df1-0c3fa89ba2bc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.978536 Aug 01 15:13:52.800727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 36/83] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:51 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:52.874437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:53.021170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:53.043663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-53e1f032-5cf6-4cfe-b936-f5d120e0a06c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.307108 Aug 01 15:13:53.045831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 48/84] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:52 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:53.416088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:53.417035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:53.430554 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.431464 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:53.434572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.438167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:53.670601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:53.671888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:53.692130 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.692880 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:53.693857 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.694501 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:53.916823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:53.929614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf93bbbb-1877-4a44-8137-e36d816c12eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.263885 Aug 01 15:13:53.931120 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 49/85] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:53 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:53.939175 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:53.940111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:53.961308 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.963334 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:53.964762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:53.965938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:54.288149 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:54.325989 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:54.328396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:54.330438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2acf7d3b-b8e2-4ce1-af4d-9946e2bafd7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.396563 Aug 01 15:13:54.331742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 50/86] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:53 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:54.346330 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:54.350665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:54.378124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:54.382991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:54.384938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:54.389662 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:54.734048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:54.748536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c6c94cbb-953a-4476-b121-cc3ad9f2a3e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.412589 Aug 01 15:13:54.750994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 51/87] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:54 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:54.764970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:54.782277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-aed1b8d2-5da7-46e8-896d-cd8ad7bd8315 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 1.369745 Aug 01 15:13:54.785763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 37/88] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:53 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:54.971528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:54.976397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:55.001300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.002061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:55.005024 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.012350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:55.380283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:55.385100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:55.422654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:55.422934 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.429561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:55.431794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.432630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:55.481719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2217e840-9ccc-47ad-a4f4-bff0bb4756dc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.521517 Aug 01 15:13:55.486843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 52/89] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:54 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:55.784679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:55.790798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:55.805036 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.805534 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:55.807384 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:55.808841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.143166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:56.203775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6448947a-0a4a-4bc6-ad35-d7e426949034 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.426691 Aug 01 15:13:56.219856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 53/90] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:55 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:56.239742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:56.250079 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:56.261417 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:56.262582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.264437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:56.265559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.397556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:56.420604 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:56.426574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:56.433109 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0b99eb43-4cb6-451d-8ab4-3eab97badb60 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 1.059668 Aug 01 15:13:56.439183 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 38/91] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:55 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:56.460496 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-8766cfc7-6c19-43ea-95f0-18419ad1720f req-6b0305f0-8387-4426-9a97-b13543def969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:56.506209 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-8766cfc7-6c19-43ea-95f0-18419ad1720f req-6b0305f0-8387-4426-9a97-b13543def969 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:56.513770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-8766cfc7-6c19-43ea-95f0-18419ad1720f req-6b0305f0-8387-4426-9a97-b13543def969 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.552011 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-8766cfc7-6c19-43ea-95f0-18419ad1720f req-6b0305f0-8387-4426-9a97-b13543def969 service nova] Creating event network-changed:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:13:56.571071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-8766cfc7-6c19-43ea-95f0-18419ad1720f req-6b0305f0-8387-4426-9a97-b13543def969 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127324 Aug 01 15:13:56.573380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 39/92] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:56.581154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:56.583160 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:56.594481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:56.595508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.598219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:56.599461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:56.707367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:56.727071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-aa621508-264d-4574-863a-66e4893d805f tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.504840 Aug 01 15:13:56.728139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 54/93] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:56 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:57.263822 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:57.266993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:57.282770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.285485 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:57.287894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.288968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:57.414397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:57.451646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-95a12e93-12bb-4f53-8fc4-7e02f4445308 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.876606 Aug 01 15:13:57.483634 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 40/94] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:56 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:57.538696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:57.542579 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:57.563682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.565489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:57.568447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.570488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:57.694206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:57.739172 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-57644da2-035d-4cb4-bdb9-10d0a5a0f74c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.483427 Aug 01 15:13:57.740830 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 55/95] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:57 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:57.764435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:57.767327 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:57.796058 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.801329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:57.804918 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:57.817146 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:58.390085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:58.415099 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-471943ba-82ca-4299-ad9d-c5084ad06725 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.658114 Aug 01 15:13:58.422992 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 56/96] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:57 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:13:58.526016 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:58.530577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:58.557125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:58.561388 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:58.565057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:58.568716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.243118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.246382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.256212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-77ed44d4-ee68-473e-a26a-1851ad6e7d39 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.743010 Aug 01 15:13:59.272831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 57/97] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:58 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:59.299766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.306792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.310564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-531ec2ff-7c3d-4b99-9941-9207b79d39df tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 1.823777 Aug 01 15:13:59.324553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 41/98] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:13:57 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:13:59.324553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1d20a-c1e7-4321-bdd2-a74e52f66489", "tag": "9023cf59-8289-4e54-ac4f-4cb12c410d41"}, {"name": "network-changed", "server_uuid": "58ba4bbd-9f40-4569-bb3d-07e13a03a61c", "tag": "645145e7-dd2d-49c9-8627-ef0c491fbaf9"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:59.349948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.350529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.370546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] Creating event network-changed:9023cf59-8289-4e54-ac4f-4cb12c410d41 for instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 on hv-cinder-80382 Aug 01 15:13:59.371558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] Creating event network-changed:645145e7-dd2d-49c9-8627-ef0c491fbaf9 for instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c on hv-cinder-80382 Aug 01 15:13:59.381482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-a0d82fe5-eb19-4cb2-afc7-5e133f4e9ff1 req-b38be2e3-f5f0-4f1b-a92e-716274900eed service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066293 Aug 01 15:13:59.383274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 42/99] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:59.394438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:59.395339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:59.405235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-da2ef567-25bd-487c-a41c-dc64c78a8e37 req-eaaef932-73d5-480c-995c-7c8714e0b2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a4af5a-02a1-4627-b6cf-6d04fa59a5ee", "name": "network-vif-plugged", "status": "completed", "tag": "1a839c00-ef8e-4234-8be0-c00f74498522"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:13:59.406972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.407566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.408404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.408903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.427037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-da2ef567-25bd-487c-a41c-dc64c78a8e37 req-eaaef932-73d5-480c-995c-7c8714e0b2bb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.435091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-da2ef567-25bd-487c-a41c-dc64c78a8e37 req-eaaef932-73d5-480c-995c-7c8714e0b2bb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.463071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-da2ef567-25bd-487c-a41c-dc64c78a8e37 req-eaaef932-73d5-480c-995c-7c8714e0b2bb service nova] Creating event network-vif-plugged:1a839c00-ef8e-4234-8be0-c00f74498522 for instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee on hv-cinder-80382 Aug 01 15:13:59.479579 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-da2ef567-25bd-487c-a41c-dc64c78a8e37 req-eaaef932-73d5-480c-995c-7c8714e0b2bb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204715 Aug 01 15:13:59.480218 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 58/100] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:13:59.500611 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:13:59.501352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:13:59.529137 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.529633 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.530519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:13:59.530960 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:13:59.660384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.670352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4a347ada-5b6b-44d0-bf17-46e826a45811 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.283201 Aug 01 15:13:59.680354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 43/101] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:59 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:13:59.820323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:13:59.826423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:13:59.836282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-83532960-01fe-49df-882d-59b115984dcf tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.354338 Aug 01 15:13:59.837432 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 59/102] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:13:59 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:00.307764 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:00.312552 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:00.343216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.344996 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.346361 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.347069 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.359253 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:00.359959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:00.380227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.382975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.387548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.388130 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.847437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:00.877801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:00.887737 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:00.891474 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4bb55f90-a48b-434b-bd84-724e980a9763 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.538030 Aug 01 15:14:00.897171 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:00.897816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 60/103] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:14:00 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:00.907419 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e64afe4a-5752-4858-9ab7-5635ec957083 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.624355 Aug 01 15:14:00.908024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 44/104] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:00 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:00.915116 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:00.916457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:00.926591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:00.927782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:00.933433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.934138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.935451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.936431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.944817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:00.969375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.973907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:00.975943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:00.977159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:01.328965 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:01.339479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2e9587c9-424e-402d-9e9a-531b6ff799af tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.428208 Aug 01 15:14:01.345511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 45/105] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:00 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:01.508502 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-d8196492-bdeb-47a6-ae96-c666075d8fb6 req-fe9d01bd-02f2-4282-8ed8-9352210b1de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af7cd8a-b958-4f36-97eb-54d514cd3989", "name": "network-vif-plugged", "status": "completed", "tag": "16fdef4d-62ea-4f57-8f5b-39a4f91caec2"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:01.532565 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-d8196492-bdeb-47a6-ae96-c666075d8fb6 req-fe9d01bd-02f2-4282-8ed8-9352210b1de6 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:01.537260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-d8196492-bdeb-47a6-ae96-c666075d8fb6 req-fe9d01bd-02f2-4282-8ed8-9352210b1de6 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:01.572932 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:01.585895 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-d8196492-bdeb-47a6-ae96-c666075d8fb6 req-fe9d01bd-02f2-4282-8ed8-9352210b1de6 service nova] Creating event network-vif-plugged:16fdef4d-62ea-4f57-8f5b-39a4f91caec2 for instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 on hv-cinder-80382 Aug 01 15:14:01.593343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-865d1ab6-e8be-4830-b479-27993e7fb57a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.692583 Aug 01 15:14:01.597055 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-d8196492-bdeb-47a6-ae96-c666075d8fb6 req-fe9d01bd-02f2-4282-8ed8-9352210b1de6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093467 Aug 01 15:14:01.597492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 61/106] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:00 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:01.599322 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 46/107] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:14:01.924568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:01.925493 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:01.927822 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=86 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:01.944424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:01.946478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:01.966527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:01.968360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:01.969601 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:01.975230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:02.008836 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.009656 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:02.017159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.019315 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:02.518709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:02.555770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c100f84e-4e6f-4caa-8326-d1bc94cd8e37 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.601022 Aug 01 15:14:02.561028 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 47/108] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:01 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:02.595939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:02.599557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:02.600608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:02.624812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.625563 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:02.626328 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:02.627705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:02.628437 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.629363 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:02.630496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ef185e83-8e54-4994-8068-0ed071cdafeb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.710649 Aug 01 15:14:02.648030 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 62/109] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:14:01 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:14:02.673626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:02.678002 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:02.697964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.698795 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:02.700352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:02.701208 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:03.340944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:03.359578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-397468aa-bfa6-419f-9816-9b5a203ef677 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.705331 Aug 01 15:14:03.371682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 63/110] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:02 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:03.615451 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:03.617276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:03.637935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:03.639465 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:03.641885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:03.643195 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:04.062774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:04.075661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-64e43633-31de-4a54-a7dc-45fdb14bb197 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 1.511858 Aug 01 15:14:04.122755 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 48/111] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:02 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:04.127973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:04.141481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:04.142206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:04.154906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=62 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:04.159277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fa202fe9-a485-4e22-9e07-25478b437363 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1322 microversion: 2.1 time: 0.559299 Aug 01 15:14:04.161218 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 64/112] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:03 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:04.193779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-7a6cf4ca-dded-4dd3-9546-e12bfba17c27 req-9231615a-c3ee-48fe-8700-e625a3fb8cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "name": "network-vif-plugged", "status": "completed", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:04.225469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:04.229493 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:04.234662 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:04.244847 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:04.269781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7a6cf4ca-dded-4dd3-9546-e12bfba17c27 req-9231615a-c3ee-48fe-8700-e625a3fb8cfc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:04.273410 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7a6cf4ca-dded-4dd3-9546-e12bfba17c27 req-9231615a-c3ee-48fe-8700-e625a3fb8cfc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:04.330852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-7a6cf4ca-dded-4dd3-9546-e12bfba17c27 req-9231615a-c3ee-48fe-8700-e625a3fb8cfc service nova] Creating event network-vif-plugged:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:14:04.339618 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-7a6cf4ca-dded-4dd3-9546-e12bfba17c27 req-9231615a-c3ee-48fe-8700-e625a3fb8cfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170804 Aug 01 15:14:04.343943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 65/113] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:04.416649 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:04.418165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:04.433578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:04.434487 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:04.435830 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:04.436548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:05.230512 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:05.279371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0bb63528-8cd2-4fad-9677-eff3fe64bb9c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.870418 Aug 01 15:14:05.287585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 66/114] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:04 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:05.334182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:05.343029 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:05.364000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:05.366383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:05.369326 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:05.370673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:05.437232 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:05.539302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:05.556816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:05.564085 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ab2da34c-f1c7-4b65-8ef8-3b0df1c49ab7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 1.436060 Aug 01 15:14:05.565421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 49/115] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:14:04 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:05.589285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:05.591393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:05.616133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:05.617161 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:05.618786 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:05.619539 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:05.686012 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:05.711064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-04003737-0951-4723-927f-65fbedbbc85c tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.388356 Aug 01 15:14:05.713286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 67/116] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:05 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:06.336745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:06.340280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:06.382539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.387676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.394058 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.395125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.465658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:06.479694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6356a9fa-8143-4910-8ccf-17cc9c632796 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1517 microversion: 2.1 time: 0.911471 Aug 01 15:14:06.480398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 50/117] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:05 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1517 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:06.523475 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:06.526615 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:06.548533 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.549783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.551032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.551683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.679777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lazy-loading 'flavor' on Instance uuid 6af7cd8a-b958-4f36-97eb-54d514cd3989 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:14:06.722445 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:06.740046 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f5ed3c25-cd2d-4d9a-9881-85bd89b49a14 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.410672 Aug 01 15:14:06.757478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 68/118] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:06 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:06.781006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:06.782889 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:06.805184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.808006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.824371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:06.824794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:06.975391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d68a1eca-d8ab-4f9c-a9e2-6f50b089bed6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989/action" status: 200 len: 32 microversion: 2.1 time: 0.455652 Aug 01 15:14:06.985446 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 51/119] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:14:06 2022] POST /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989/action => generated 32 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 15:14:07.028549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:07.030544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:07.054042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.058254 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:07.059801 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.060561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:07.266562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:07.285398 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:07.289039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:07.291823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e0ee4a49-bf2c-42a6-9946-88090b413c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1407 microversion: 2.20 time: 0.518543 Aug 01 15:14:07.292924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 69/120] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:14:06 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:07.336781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:07.338080 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:07.348349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.348904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:07.350351 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.350800 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:07.788408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:07.819732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bbcbc1ee-6022-4cc9-bc49-2f89a4f5ec16 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.524683 Aug 01 15:14:07.839588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 70/121] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:07 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:07.846282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:07.854071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:07.885648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.889888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:07.894868 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:07.914010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:08.146627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:08.163640 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8a2cc094-d534-4d60-8d18-efa6bb7a1509 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 1.177291 Aug 01 15:14:08.187292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 52/122] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:06 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:08.193609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-0c161de7-6401-4749-a5ce-517ff5bb3073 req-47f43f67-dfd3-44cc-8593-4aa894234be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba4bbd-9f40-4569-bb3d-07e13a03a61c", "name": "network-vif-plugged", "status": "completed", "tag": "645145e7-dd2d-49c9-8627-ef0c491fbaf9"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:08.219684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-0c161de7-6401-4749-a5ce-517ff5bb3073 req-47f43f67-dfd3-44cc-8593-4aa894234be7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:08.220314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-0c161de7-6401-4749-a5ce-517ff5bb3073 req-47f43f67-dfd3-44cc-8593-4aa894234be7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:08.269131 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-0c161de7-6401-4749-a5ce-517ff5bb3073 req-47f43f67-dfd3-44cc-8593-4aa894234be7 service nova] Creating event network-vif-plugged:645145e7-dd2d-49c9-8627-ef0c491fbaf9 for instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c on hv-cinder-80382 Aug 01 15:14:08.285367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-0c161de7-6401-4749-a5ce-517ff5bb3073 req-47f43f67-dfd3-44cc-8593-4aa894234be7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096535 Aug 01 15:14:08.289868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 53/123] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:08.395206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:08.409289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:08.472415 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:08.477097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:08.479319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:08.482682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:08.585879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:08.604483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-50e31228-fade-4fb3-9f26-7e1c306c081f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.772912 Aug 01 15:14:08.608093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 71/124] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:07 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:08.856203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:08.859716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:08.879306 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:08.880676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:08.885440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:08.886569 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.176398 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:09.191677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0aea51ac-68e5-44a2-a204-784a8b065b10 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.345988 Aug 01 15:14:09.193602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 72/125] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:08 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:09.254571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:09.256865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:09.274189 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.275821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.277519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.278562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.538651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:09.552354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:09.556074 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:09.567383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4a1fc510-f0ae-4493-9eea-6d2121ac1ae5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1598 microversion: 2.20 time: 1.232144 Aug 01 15:14:09.575057 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 54/126] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:14:08 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1598 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:14:09.601973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:09.605255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:09.620893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.621351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.622827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.624330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.674748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:09.686688 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1534313f-67a1-4574-82dd-581e87eccb20 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 0.440986 Aug 01 15:14:09.693324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 73/127] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:09 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:09.707761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:09.708405 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:09.722638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.722984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:09.729031 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:09.729481 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.151106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:10.168728 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2eb0edf2-aa63-4a39-8f2f-fc7bb501c5bf tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.473205 Aug 01 15:14:10.170312 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 74/128] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:09 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:10.230299 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-678bd1b6-64f1-47c5-926f-509e0ec926fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.632445 Aug 01 15:14:10.240795 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 55/129] 10.222.0.93 () {60 vars in 1316 bytes} [Mon Aug 1 15:14:09 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-interface => generated 284 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:14:10.241359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:10.243654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:10.257435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:10.258855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.263602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:10.264566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.329777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-db624664-45c1-401c-8210-a790da1f5520 req-a9df5a20-3ab2-4cc0-836c-49d169355c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1d20a-c1e7-4321-bdd2-a74e52f66489", "name": "network-vif-plugged", "status": "completed", "tag": "9023cf59-8289-4e54-ac4f-4cb12c410d41"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:10.370547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-db624664-45c1-401c-8210-a790da1f5520 req-a9df5a20-3ab2-4cc0-836c-49d169355c2e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:10.374517 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-db624664-45c1-401c-8210-a790da1f5520 req-a9df5a20-3ab2-4cc0-836c-49d169355c2e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.458380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-db624664-45c1-401c-8210-a790da1f5520 req-a9df5a20-3ab2-4cc0-836c-49d169355c2e service nova] Creating event network-vif-plugged:9023cf59-8289-4e54-ac4f-4cb12c410d41 for instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 on hv-cinder-80382 Aug 01 15:14:10.482863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-db624664-45c1-401c-8210-a790da1f5520 req-a9df5a20-3ab2-4cc0-836c-49d169355c2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161762 Aug 01 15:14:10.488244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 56/130] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:14:10.716538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:10.719872 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:10.755806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:10.757060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.758884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:10.760616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:10.909435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:10.932873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5ddec9a3-f7f1-415d-8e8c-2c869b9267b6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.700633 Aug 01 15:14:10.933893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 75/131] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:10 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:11.192929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:11.193489 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:11.210689 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:11.211154 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:11.212029 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:11.212494 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:11.771067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:11.817956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-785c1dcb-823f-4607-b0bb-e6799b819569 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1315 microversion: 2.1 time: 1.110071 Aug 01 15:14:11.837574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 57/132] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:10 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:11.984383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:11.985269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:12.025848 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:12.026316 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:12.030341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:12.031005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:12.314696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:12.342738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-26955f40-5ae1-4cd5-be75-a8442ec589be tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 1.153442 Aug 01 15:14:12.392162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 76/133] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:11 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:12.423650 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:12.435904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f122b0b0-42b3-41da-b86e-c0b1fec4d397 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.471680 Aug 01 15:14:12.449302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 58/134] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:11 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:12.880038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:12.882343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:12.908419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:12.909631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:12.913245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:12.914415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:12.981605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:13.397810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:13.399945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:13.424799 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:13.433646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:13.434385 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:13.435458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:13.438827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:13.459177 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-72716eea-c449-4a11-aa99-03a5a1f934f8 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1501 microversion: 2.1 time: 0.603330 Aug 01 15:14:13.477802 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 77/135] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:12 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1501 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:13.523442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:13.542591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:13.569936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:13.577310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:13.579399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:13.585481 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:13.961887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:13.998313 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5e83c1f0-148f-4d08-b2b0-f3c6a1a0a024 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1362 microversion: 2.1 time: 0.602653 Aug 01 15:14:14.006282 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 59/136] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:13 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:14.204330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-775ebef8-e658-4dd1-9e66-ef4550cf71b5 req-0814920b-a090-4190-8584-11a08f0c9b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:14.222094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-775ebef8-e658-4dd1-9e66-ef4550cf71b5 req-0814920b-a090-4190-8584-11a08f0c9b49 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:14.223062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-775ebef8-e658-4dd1-9e66-ef4550cf71b5 req-0814920b-a090-4190-8584-11a08f0c9b49 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:14.254725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-775ebef8-e658-4dd1-9e66-ef4550cf71b5 req-0814920b-a090-4190-8584-11a08f0c9b49 service nova] Creating event network-changed:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:14:14.268608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-775ebef8-e658-4dd1-9e66-ef4550cf71b5 req-0814920b-a090-4190-8584-11a08f0c9b49 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074275 Aug 01 15:14:14.269731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 60/137] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:14:14.700586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:14.729120 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e9657af4-c398-4c23-90f4-b7c5be347113 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.239892 Aug 01 15:14:14.734569 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 78/138] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:13 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:15.040901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:15.043462 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:15.076226 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:15.077686 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:15.084211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:15.110007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:15.770609 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4063079d-40e9-469d-9c29-bfec0e92f0e5"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:15.776038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:15.805512 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:15.805990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:15.806845 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:15.807279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:15.975280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:15.985323 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c92b18b5-dcd4-46d5-980a-978433e89a27 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1549 microversion: 2.1 time: 0.959279 Aug 01 15:14:15.991893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 61/139] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:15 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1549 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:16.004491 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:16.014600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:16.034788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:16.035218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:16.036156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:16.045370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:16.731303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:16.737126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:16.762238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ba1ab8c7-9117-4ad3-a694-2caef7653e92 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.767331 Aug 01 15:14:16.763271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 62/140] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:15 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:16.785285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:16.785285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:16.834902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:16.836051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:16.841927 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:16.851118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:17.033734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6f267189-c6f6-45f5-9583-9d91e915d9f7 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "POST /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.261917 Aug 01 15:14:17.050820 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 79/141] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:14:15 2022] POST /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c/os-volume_attachments => generated 194 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:17.166562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ccbfde63-f051-416d-bea7-ff94ba3ec878 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.401681 Aug 01 15:14:17.167851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 63/142] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:14:16 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-interface => generated 285 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:17.815574 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:17.816283 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:17.880763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:17.884345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:17.888032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:17.892548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:18.794302 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:18.850591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f9af994-7ae4-4333-88b3-586c8c89fbe5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.043321 Aug 01 15:14:18.851455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 80/143] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:17 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:19.887373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:19.891168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:19.915961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:19.944112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:19.958521 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:19.959966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:21.145192 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:21.155585 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-da360241-ace5-4c72-8f7f-a28d85830182 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.279816 Aug 01 15:14:21.164995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 64/144] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:19 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:22.204284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:22.205463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:22.263251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:22.264043 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:22.278174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:22.278978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:22.291084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-b9736050-d2bd-4114-a53a-e757f79536f7 req-bc7931e2-c529-481d-a959-7e3c0ea1e476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde1d20a-c1e7-4321-bdd2-a74e52f66489", "tag": "9023cf59-8289-4e54-ac4f-4cb12c410d41"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:22.361906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b9736050-d2bd-4114-a53a-e757f79536f7 req-bc7931e2-c529-481d-a959-7e3c0ea1e476 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:22.363214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b9736050-d2bd-4114-a53a-e757f79536f7 req-bc7931e2-c529-481d-a959-7e3c0ea1e476 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:22.387807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-b9736050-d2bd-4114-a53a-e757f79536f7 req-bc7931e2-c529-481d-a959-7e3c0ea1e476 service nova] Creating event network-changed:9023cf59-8289-4e54-ac4f-4cb12c410d41 for instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 on hv-cinder-80382 Aug 01 15:14:22.401653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-b9736050-d2bd-4114-a53a-e757f79536f7 req-bc7931e2-c529-481d-a959-7e3c0ea1e476 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117496 Aug 01 15:14:22.403363 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 65/145] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:14:23.033102 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:23.053423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f3e56d5-846e-4e22-85e6-d0d6ff1aa965 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.854800 Aug 01 15:14:23.058232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 81/146] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:22 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:24.104522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:24.106527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:24.121295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:24.126376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:24.129545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:24.131142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:25.053600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:25.091398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-eade0d06-d256-48e3-8517-e0794e462060 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.998288 Aug 01 15:14:25.093489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 66/147] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:24 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:26.152485 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:26.153322 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:26.187612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:26.188095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:26.189657 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:26.190174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:26.627171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:26.640511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-532c068e-7527-4284-aace-88256bd8972a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.496209 Aug 01 15:14:26.643901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 82/148] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:26 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:27.099805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.099805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:27.115710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.118891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:27.120185 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.120906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:27.181785 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:14:27.477612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-45a0afa2-f72f-4660-b86c-667cf4273af5 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 204 len: 0 microversion: 2.1 time: 0.378837 Aug 01 15:14:27.482047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 67/149] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:14:27 2022] DELETE /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:14:27.513199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.531041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:27.587599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.588635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:27.590628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.592282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:27.705408 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:27.713247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:27.743950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.745150 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:27.748003 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:27.755790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:28.056808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:28.089576 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f79f78ed-f877-47d6-a375-72bbbfd298ab tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1553 microversion: 2.1 time: 0.600473 Aug 01 15:14:28.094503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 83/150] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:27 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1553 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:28.432670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:28.448928 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2516f991-5be7-4945-97e1-83bcd7550c01 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.767568 Aug 01 15:14:28.451257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 68/151] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:27 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:29.134636 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:29.145861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:29.169181 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:29.169641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:29.173923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:29.174388 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:29.516677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:29.518131 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:29.546429 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:29.548737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:29.554274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:29.554787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:29.674672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:29.691771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-27c48da5-8c0d-49e9-8d42-1bd8c2b6e04d tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1553 microversion: 2.1 time: 0.564230 Aug 01 15:14:29.720161 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 84/152] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:29 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1553 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:30.514940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:30.532590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b91f39b2-a5cc-4c38-9ede-aa20dd492217 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.047096 Aug 01 15:14:30.553138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 69/153] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:29 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:30.733645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:30.736984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:30.765544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:30.766391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:30.767991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:30.768794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:31.186961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:31.223375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f9da5c75-40cc-4768-9431-e3e4dc32791b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1553 microversion: 2.1 time: 0.500609 Aug 01 15:14:31.232436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 85/154] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:30 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1553 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:31.542350 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-11459ec0-7726-4eaf-b9ae-5c49c45cdffc req-62cd2ecd-48ba-42e6-9bfc-84a26b8e05d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ba4bbd-9f40-4569-bb3d-07e13a03a61c", "name": "network-vif-deleted", "tag": "645145e7-dd2d-49c9-8627-ef0c491fbaf9"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:31.572836 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:31.573876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:31.584805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-11459ec0-7726-4eaf-b9ae-5c49c45cdffc req-62cd2ecd-48ba-42e6-9bfc-84a26b8e05d1 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:31.586957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-11459ec0-7726-4eaf-b9ae-5c49c45cdffc req-62cd2ecd-48ba-42e6-9bfc-84a26b8e05d1 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:31.592246 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:31.595280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:31.601755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:31.602562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:31.624736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-11459ec0-7726-4eaf-b9ae-5c49c45cdffc req-62cd2ecd-48ba-42e6-9bfc-84a26b8e05d1 service nova] Creating event network-vif-deleted:645145e7-dd2d-49c9-8627-ef0c491fbaf9 for instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c on hv-cinder-80382 Aug 01 15:14:31.641093 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-11459ec0-7726-4eaf-b9ae-5c49c45cdffc req-62cd2ecd-48ba-42e6-9bfc-84a26b8e05d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105798 Aug 01 15:14:31.643324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 70/155] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:14:32.018132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:32.047738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-862cf6b7-bd76-459d-9936-d8a63cbd8369 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.477664 Aug 01 15:14:32.051749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 86/156] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:31 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:32.298016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:32.301574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:32.323747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:32.324614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:32.326190 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:32.336500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:32.453509 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:32.454551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:32.455443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lazy-loading 'fault' on Instance uuid 58ba4bbd-9f40-4569-bb3d-07e13a03a61c {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:14:32.974523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e708da2136a248c196ae4ecb531bb322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e95123daab4cd285589cb523685623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:33.019642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2b91e6dc-68d1-4574-b436-3eb5216f781b tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 200 len: 1351 microversion: 2.1 time: 0.747415 Aug 01 15:14:33.022095 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 71/157] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:32 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 1351 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:33.091760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:33.096097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:33.100882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=50 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:33.123206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:33.128518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:33.136720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:33.143577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:33.696825 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:33.734379 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c95499c2-bba0-45b3-9460-ba9b05f5119b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.646774 Aug 01 15:14:33.738483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 87/158] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:33 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:34.062667 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:34.063966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:34.098168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.102402 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:34.103849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.104668 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:34.177249 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] HTTP exception thrown: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Request method failure captured: Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c HTTP/1.1 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-2J17WTfrVdZwGNp6TRSbAB_GoGltku1UV_-OPGAQTf_-db_9bcpHn6K__z602ZzbxxjY32c54jIX-zXj64DMwWlXxMUH2Va1g3y3P7MyKA_0VMrQ3CXgnx345NuxAGwdKL4MpnkEUcrVEadRfKtu3fbudDYsLddkmOqvkZNHMDiqE Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:14:34.194614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_51e95123daab4cd285589cb523685623", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/51e95123daab4cd285589cb523685623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: e708da2136a248c196ae4ecb531bb322 Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.197637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '58ba4bbd-9f40-4569-bb3d-07e13a03a61c'} Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:34.199212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.201823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.206357 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Returning 404 to user: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:34.209296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4c8d15b0-f2e9-4409-a317-7db698a7b846 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 404 len: 111 microversion: 2.1 time: 0.155645 Aug 01 15:14:34.216952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 72/159] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:34 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:34.627955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:34.634878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:34.652740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.654000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:34.655726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.657234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:34.689093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] HTTP exception thrown: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Request method failure captured: Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c/os-volume_attachments HTTP/1.1 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-2J17WTfrVdZwGNp6TRSbAB_GoGltku1UV_-OPGAQTf_-db_9bcpHn6K__z602ZzbxxjY32c54jIX-zXj64DMwWlXxMUH2Va1g3y3P7MyKA_0VMrQ3CXgnx345NuxAGwdKL4MpnkEUcrVEadRfKtu3fbudDYsLddkmOqvkZNHMDiqE Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:34.700861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_51e95123daab4cd285589cb523685623", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/51e95123daab4cd285589cb523685623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: e708da2136a248c196ae4ecb531bb322 Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.703385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'server_id': '58ba4bbd-9f40-4569-bb3d-07e13a03a61c'} Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:34.704870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:34.707156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:34.710631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Returning 404 to user: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:34.712821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7a3cfafd-f592-4a07-8dc4-107226dd7cea tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.093591 Aug 01 15:14:34.714901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 88/160] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:14:34 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c/os-volume_attachments => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:34.766133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:34.770865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:34.800750 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:34.809152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.810550 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:34.814278 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:34.815509 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:35.237370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:35.256422 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f4bc6314-4b3d-4dc4-866f-972d68f64823 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.498417 Aug 01 15:14:35.259035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 73/161] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:34 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:36.303616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:36.307223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:36.308896 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:36.309700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:36.316826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.317284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.318207 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.318657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.327372 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.328586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.330249 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.331294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.362911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] HTTP exception thrown: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Request method failure captured: Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c HTTP/1.1 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-2J17WTfrVdZwGNp6TRSbAB_GoGltku1UV_-OPGAQTf_-db_9bcpHn6K__z602ZzbxxjY32c54jIX-zXj64DMwWlXxMUH2Va1g3y3P7MyKA_0VMrQ3CXgnx345NuxAGwdKL4MpnkEUcrVEadRfKtu3fbudDYsLddkmOqvkZNHMDiqE Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:14:36.364888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_51e95123daab4cd285589cb523685623", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/51e95123daab4cd285589cb523685623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: e708da2136a248c196ae4ecb531bb322 Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.371389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '58ba4bbd-9f40-4569-bb3d-07e13a03a61c'} Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:36.372972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.375544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.380698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Returning 404 to user: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:36.380698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-938e1028-2182-4867-9363-5010e119fb63 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "DELETE /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 404 len: 111 microversion: 2.1 time: 0.062386 Aug 01 15:14:36.380698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 74/162] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:14:36 2022] DELETE /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:36.380698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:36.380698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] [instance: 58ba4bbd-9f40-4569-bb3d-07e13a03a61c] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:36.396030 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.396515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.397406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:36.398162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:36.434615 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] HTTP exception thrown: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Request method failure captured: Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c HTTP/1.1 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-2J17WTfrVdZwGNp6TRSbAB_GoGltku1UV_-OPGAQTf_-db_9bcpHn6K__z602ZzbxxjY32c54jIX-zXj64DMwWlXxMUH2Va1g3y3P7MyKA_0VMrQ3CXgnx345NuxAGwdKL4MpnkEUcrVEadRfKtu3fbudDYsLddkmOqvkZNHMDiqE Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:14:36.436212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_51e95123daab4cd285589cb523685623", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/51e95123daab4cd285589cb523685623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/51e95123daab4cd285589cb523685623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 51e95123daab4cd285589cb523685623 Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-DeleteServersTestJSON-633797590 Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: e708da2136a248c196ae4ecb531bb322 Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-DeleteServersTestJSON-633797590-project Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.438581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '58ba4bbd-9f40-4569-bb3d-07e13a03a61c'} Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:36.439862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. Aug 01 15:14:36.443352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:14:36.449244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] Returning 404 to user: Instance 58ba4bbd-9f40-4569-bb3d-07e13a03a61c could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:36.450253 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-525d6381-3c0a-4e49-a568-91fddd649eb2 tempest-DeleteServersTestJSON-633797590 tempest-DeleteServersTestJSON-633797590-project] 10.222.0.93 "GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c" status: 404 len: 111 microversion: 2.1 time: 0.076371 Aug 01 15:14:36.450899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 75/163] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:36 2022] GET /compute/v2.1/servers/58ba4bbd-9f40-4569-bb3d-07e13a03a61c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:14:36.706393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:36.730813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b7e58ea8-c77a-4b3e-9cc8-c2946d23ecde tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.434252 Aug 01 15:14:36.743415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 89/164] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:36 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:37.770730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:37.771800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:37.811852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:37.812600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:37.814209 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:37.818301 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:38.886013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:38.904820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-50844345-3cad-4ae3-a701-b21e425dd1bc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.139822 Aug 01 15:14:38.917067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 76/165] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:37 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:39.968316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:39.972218 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:40.002998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:40.004316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:40.009945 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:40.012409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:40.486318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:40.508433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-281b14c7-8792-4de5-a713-98523bcf4b22 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.563054 Aug 01 15:14:40.538956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 90/166] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:39 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:41.576310 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:41.577723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:41.588284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:41.593157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:41.596244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:41.602231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:42.269889 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:42.325567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c357979a-3bd9-4cfa-99a3-5b3057697cbc tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.746656 Aug 01 15:14:42.332528 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 77/167] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:41 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:43.365338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:43.366212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:43.384723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:43.385713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:43.387001 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:43.396647 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:43.401174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:44.547007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:44.557615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d1790db9-e84d-479d-a399-d2ec24f63271 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 1.196190 Aug 01 15:14:44.573564 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 91/168] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:43 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:14:45.590743 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:45.592280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:45.606640 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:45.610619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:45.613308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:45.615146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:46.370812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:46.391371 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2880a29f-61b9-4687-b762-58284c0f93e6 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1523 microversion: 2.1 time: 0.809413 Aug 01 15:14:46.392077 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 78/169] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:45 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1523 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:47.425290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:47.426054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:47.453626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:47.454127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:47.455050 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:47.455583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:48.016127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:48.033230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9734cebb-ed7e-490b-a818-ecc02e485550 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1503 microversion: 2.1 time: 0.623167 Aug 01 15:14:48.042490 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 92/170] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:47 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:48.088860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:48.090944 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:48.125844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:48.126902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:48.131904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:48.133298 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:48.148730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:14:48.741386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:48.754648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b2462c39-fb0f-40f0-8da3-e27376bf7e7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1517 microversion: 2.1 time: 0.674668 Aug 01 15:14:48.756527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 79/171] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:48 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:50.957572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:50.963300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:50.974839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:50.976098 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:50.977797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:50.978526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:51.028685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lazy-loading 'flavor' on Instance uuid 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:14:51.439555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-229e79db-ed1d-447f-a92b-08861c05f977 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/action" status: 200 len: 32 microversion: 2.1 time: 0.487961 Aug 01 15:14:51.447373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 80/172] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:14:50 2022] POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/action => generated 32 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:14:51.471284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:51.472988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:51.529414 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:51.530573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:51.532425 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:51.533567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:51.650624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ba9e13b-6ba5-4098-87a6-362f82abd041 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Action: 'create', calling method: .version_select at 0x7fc9ecc3dca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-196853698", "metadata": {"Type": "work"}}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ba9e13b-6ba5-4098-87a6-362f82abd041 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 121 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:51.681254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-196853698", "metadata": {"Type": "work"}}} Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:51.683763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-196853698', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:51.685725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:51.688206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:51.690631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 15:14:51.690631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.692718 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ba9e13b-6ba5-4098-87a6-362f82abd041 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:51.694897 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ba9e13b-6ba5-4098-87a6-362f82abd041 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.920477 Aug 01 15:14:51.699226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 93/173] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Aug 1 15:14:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 925 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:14:51.719849 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9af8817-4ad5-4b9e-aea7-e79ec076dcf2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Action: 'create', calling method: .version_select at 0x7fc9ecc23550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-108000993", "metadata": {"Type": "work"}}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9af8817-4ad5-4b9e-aea7-e79ec076dcf2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 119 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:51.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-108000993", "metadata": {"Type": "work"}}} Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:51.731878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-108000993', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi '0' Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:51.733510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:51.735324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:51.737338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 15:14:51.737338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.740245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9af8817-4ad5-4b9e-aea7-e79ec076dcf2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:51.745919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f9af8817-4ad5-4b9e-aea7-e79ec076dcf2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040858 Aug 01 15:14:51.749015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 94/174] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Aug 1 15:14:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:14:51.764389 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7e2765c-e22b-4b60-a89a-67ad8243738a tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Action: 'create', calling method: .version_select at 0x7fc9ecae2280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-845110234", "metadata": {"Type": "work"}}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7e2765c-e22b-4b60-a89a-67ad8243738a tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 118 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:51.776035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-845110234", "metadata": {"Type": "work"}}} Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:51.777936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-845110234', 'metadata': {'Type': 'work'}}}} Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise error Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi '' Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:51.778879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 15:14:51.780545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 15:14:51.781806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 15:14:51.781806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.786172 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7e2765c-e22b-4b60-a89a-67ad8243738a tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:51.787965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7e2765c-e22b-4b60-a89a-67ad8243738a tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030091 Aug 01 15:14:51.793654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 95/175] 10.222.0.93 () {60 vars in 1156 bytes} [Mon Aug 1 15:14:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:14:51.813979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-355c8565-4596-4f27-9bb2-49a5a63a2dd2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Calling method '.version_select at 0x7fc9ecc23160>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:51.914473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-355c8565-4596-4f27-9bb2-49a5a63a2dd2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] HTTP exception thrown: Volume tempest-invalid-340149849 could not be found. Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-355c8565-4596-4f27-9bb2-49a5a63a2dd2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-340149849 HTTP/1.1 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:51.918502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Volume tempest-invalid-340149849 could not be found. Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'tempest-invalid-340149849'} Aug 01 15:14:51.919961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-340149849 could not be found. (HTTP 404) (Request-ID: req-d1301d19-ee72-45bd-8488-94325b4b0f42) Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.921074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:51.925716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-340149849 could not be found. Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:51.928003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-340149849 could not be found. Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-340149849 could not be found. Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-355c8565-4596-4f27-9bb2-49a5a63a2dd2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 404 to user: Volume tempest-invalid-340149849 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-355c8565-4596-4f27-9bb2-49a5a63a2dd2 tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-340149849" status: 404 len: 98 microversion: 2.1 time: 0.113435 Aug 01 15:14:51.930558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 96/176] 10.222.0.93 () {58 vars in 1215 bytes} [Mon Aug 1 15:14:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-340149849 => generated 98 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 15:14:51.939149 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b1de11a2-68ee-4a67-ac2c-37d44cdcebfe tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007655 Aug 01 15:14:51.945536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 97/177] 10.222.0.93 () {58 vars in 1140 bytes} [Mon Aug 1 15:14:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:14:51.953324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4fd47b3c-110d-4344-b147-1410cbfa792e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003917 Aug 01 15:14:51.954038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 98/178] 10.222.0.93 () {58 vars in 1137 bytes} [Mon Aug 1 15:14:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 15:14:51.975097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f5e7b469-b8ec-4e3b-8d15-a5e692694edc tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Calling method '.version_select at 0x7fc9ecab0940>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:52.058414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f5e7b469-b8ec-4e3b-8d15-a5e692694edc tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] HTTP exception thrown: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f5e7b469-b8ec-4e3b-8d15-a5e692694edc tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/os-volumes/8e52c124-db5d-4bfa-8286-47b12453bbd3 HTTP/1.1 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:52.062570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '8e52c124-db5d-4bfa-8286-47b12453bbd3'} Aug 01 15:14:52.066619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. (HTTP 404) (Request-ID: req-aaae853b-b3c9-40e6-96a3-f5d194341e59) Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.068621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:14:52.071300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:14:52.075321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f5e7b469-b8ec-4e3b-8d15-a5e692694edc tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 404 to user: Volume 8e52c124-db5d-4bfa-8286-47b12453bbd3 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:52.079843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f5e7b469-b8ec-4e3b-8d15-a5e692694edc tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/8e52c124-db5d-4bfa-8286-47b12453bbd3" status: 404 len: 109 microversion: 2.1 time: 0.102669 Aug 01 15:14:52.086411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 99/179] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:14:51 2022] DELETE /compute/v2.1/os-volumes/8e52c124-db5d-4bfa-8286-47b12453bbd3 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:52.094665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e9dd4b25-3aaf-4f34-8fbc-f9fc5abc930e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Calling method '.version_select at 0x7fc9ecab0e50>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:52.158081 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-e9dd4b25-3aaf-4f34-8fbc-f9fc5abc930e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] HTTP exception thrown: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e9dd4b25-3aaf-4f34-8fbc-f9fc5abc930e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Request method failure captured: Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/os-volumes/2df3e13a-54fc-438b-963b-d9fa5534c937 HTTP/1.1 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3qxepGIcmpzR6NUwwJ7lyYX5hSFmGKQHjkRhoO-k2yjmiqB6_YY_YXkc1ABc6c0tdi8-z_YbP6B9Ss1qoD3YHhO8O9trVeVQORA7f6xywIjvZhSaf6y8EYr9fwBwdTLFOCeZLsqk8cZBbq8AAWaGKN3-7dM_xvHwRYb6pdSeedir4 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:14:52.161665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_5c7fb0f42d4d413ba366897936e129fd", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/5c7fb0f42d4d413ba366897936e129fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 5c7fb0f42d4d413ba366897936e129fd Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesNegativeTest-727058922 Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: eb60592f0e034007ae0561113310fb4a Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesNegativeTest-727058922-project Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '2df3e13a-54fc-438b-963b-d9fa5534c937'} Aug 01 15:14:52.164097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. (HTTP 404) (Request-ID: req-6beefae3-6c9a-4ce1-8542-8931a7c363c3) Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.166380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:14:52.168881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:14:52.174117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e9dd4b25-3aaf-4f34-8fbc-f9fc5abc930e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] Returning 404 to user: Volume 2df3e13a-54fc-438b-963b-d9fa5534c937 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e9dd4b25-3aaf-4f34-8fbc-f9fc5abc930e tempest-VolumesNegativeTest-727058922 tempest-VolumesNegativeTest-727058922-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/2df3e13a-54fc-438b-963b-d9fa5534c937" status: 404 len: 109 microversion: 2.1 time: 0.079741 Aug 01 15:14:52.176510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 100/180] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:14:52 2022] GET /compute/v2.1/os-volumes/2df3e13a-54fc-438b-963b-d9fa5534c937 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:14:52.349145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:52.383630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-26d91b20-dfe9-4c39-8110-95c7326fac55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.926725 Aug 01 15:14:52.386232 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 81/181] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:51 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:53.426985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:53.428021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:53.469014 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.470240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:53.471829 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:53.473563 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:54.025091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:54.044647 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-035e7ee7-895e-4810-957d-4ce90476360e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.624029 Aug 01 15:14:54.057134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 101/182] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:53 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:55.091219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:55.093693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:55.120139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:55.126444 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:55.127934 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:55.131122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:55.540473 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:55.555403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cd79316d-a343-40de-b8cd-06a39ec41e72 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.471612 Aug 01 15:14:55.556182 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 82/183] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:55 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:56.582302 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:56.584148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:56.610715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.614276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.617712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:56.618674 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:56.978006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:56.990353 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-942a68a1-6eed-4eb6-95be-c4df93a0ea84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.413444 Aug 01 15:14:57.004537 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 102/184] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:56 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:58.033550 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:58.034719 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:58.051781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.052386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.056357 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.057098 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.279848 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:58.291536 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3acf2a4a-c08a-46a3-9347-c68dace0c4d4 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.262786 Aug 01 15:14:58.293045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 83/185] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:58 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:14:58.650918 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:58.653620 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:58.675908 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.677755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.680235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:58.681473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:58.755073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ed16a921-e1e1-4e82-a4ac-8944400a655a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/ips" status: 200 len: 151 microversion: 2.20 time: 0.113882 Aug 01 15:14:58.757496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 103/186] 10.222.0.93 () {60 vars in 1289 bytes} [Mon Aug 1 15:14:58 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/ips => generated 151 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:14:59.338165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:14:59.341628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:14:59.354315 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.355197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.356883 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:14:59.358644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:14:59.820994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:14:59.854152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-77bbfca1-64d8-49bf-9951-6455cb4acb88 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.525625 Aug 01 15:14:59.883659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 84/187] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:14:59 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:00.795131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-23472116-0075-425d-b4f7-81c1f37579ef tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'create', calling method: .version_select at 0x7fc9ecb41e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-287703795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl+B1B7u45kD2WUkLiy47uzJrFPFm8tLJHhFsvTjgCZ30erII60Aa2PWCxhY85OGBgKqOuEhs86wFgC8gmP8q/em8oFTpv2cJEUQ10jIYkaDUEYlJCuppMr4o3yua7RMg=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:00.832041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-23472116-0075-425d-b4f7-81c1f37579ef tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Getting quotas for project 03ff255ce0464ad49313432927bb4daf. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:15:00.841027 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-23472116-0075-425d-b4f7-81c1f37579ef tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Getting quotas for user 16f05877e10442d2a8938f6805eff842 and project 03ff255ce0464ad49313432927bb4daf. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:15:00.887867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-23472116-0075-425d-b4f7-81c1f37579ef tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.103333 Aug 01 15:15:00.889006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 104/188] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:15:00 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:00.946777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:00.947939 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:00.962391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:00.963569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:00.966424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:00.967817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.094624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1541562874", "imageRef": "59cb9051-25d5-4074-a7b2-7c448dcc2a64", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-287703795", "networks": [{"uuid": "d79a8818-2270-4441-9e73-426ec0426f54"}]}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:01.208441 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] validate_networks() for [('d79a8818-2270-4441-9e73-426ec0426f54', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:15:01.248589 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:01.264417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-78234b2c-cbac-49fa-86bd-04d8e55ea675 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.327361 Aug 01 15:15:01.266301 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 85/189] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:00 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:01.872068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:01.874308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:01.886923 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.888817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.891180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.892067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.908425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:15:01.909767 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:15:01.911297 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:15:01.912291 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:15:01.913089 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:15:01.937982 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.938944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.940160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:01.941342 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:01.964767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lazy-loading 'flavor' on Instance uuid f38a15b5-6333-48d9-89cc-fd29dd223d7e {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:15:01.981513 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Getting quotas for project 03ff255ce0464ad49313432927bb4daf. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:15:01.990436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Getting quotas for user 16f05877e10442d2a8938f6805eff842 and project 03ff255ce0464ad49313432927bb4daf. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:15:02.016364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:15:02.021995 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='59cb9051-25d5-4074-a7b2-7c448dcc2a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:15:02.141118 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ec52be2a-97f6-4636-abfa-f51445221a39 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052630 Aug 01 15:15:02.158749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 105/190] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:15:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:15:02.170226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-66380cf8-ce6b-4826-8bbd-87b3fb735b07 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.171599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-66380cf8-ce6b-4826-8bbd-87b3fb735b07 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.258475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-66380cf8-ce6b-4826-8bbd-87b3fb735b07 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.268705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-66380cf8-ce6b-4826-8bbd-87b3fb735b07 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1258 microversion: 2.1 time: 0.106253 Aug 01 15:15:02.270952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 106/191] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1258 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:02.295386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.295914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d2073490-3e60-4bf8-89cb-8db8f5931948 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/action" status: 202 len: 0 microversion: 2.20 time: 0.421538 Aug 01 15:15:02.296603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.306432 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 86/192] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Aug 1 15:15:01 2022] POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:15:02.307500 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.307978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.310955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.311410 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.318655 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:02.320118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:02.328850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.329538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.332087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:02.332956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:02.570083 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.585607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.587741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.590100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-54c6cc03-7a7f-4517-be34-de2c0999a89f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.281336 Aug 01 15:15:02.590980 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 87/193] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:02.619424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:02.636923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dbcbdb59-5453-43f0-a22c-27cf918bf494 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.346250 Aug 01 15:15:02.638532 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 107/194] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:02 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:03.295725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.296611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.308290 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.309210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.310773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.311547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.407506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.426295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a2ebec26-0a36-48d3-8f9e-a7be950e38c1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1262 microversion: 2.1 time: 0.134048 Aug 01 15:15:03.427012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 88/195] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1262 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:03.625644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.626332 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.630000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:03.640230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.640716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.641901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.642598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.677166 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:03.678078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:03.687194 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.687820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.688861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:03.690148 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:03.828422 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.838911 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.840499 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.841832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-557472e7-7f9d-436f-81d1-94fce4080ccb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.223382 Aug 01 15:15:03.842813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 108/196] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:03.918102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:03.929913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b6c8b412-4f69-4c39-99a3-0bfbc91da6bf tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.257833 Aug 01 15:15:03.930987 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 89/197] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:03 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:04.462996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.463610 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.470981 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.471448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.472281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.472786 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.593595 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:04.603386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0153d8c8-a41e-43f8-af9a-f2e1b0330515 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1262 microversion: 2.1 time: 0.144423 Aug 01 15:15:04.608033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 109/198] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:04.870607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.871365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.874757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=34 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:04.888955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.889778 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.891246 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.892052 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.959304 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:04.960421 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:04.968182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.968902 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:04.969856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:04.970232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.263893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.269181 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.284293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-258e3906-c9d1-415b-9551-7491bc825689 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.329414 Aug 01 15:15:05.286681 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.288426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 110/199] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:05.291461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.293920 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7b033fba-407d-4163-98d2-07ada1162dd7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.429146 Aug 01 15:15:05.295504 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 90/200] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:04 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:05.307768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:05.309494 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:05.324682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.325630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.327017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.327747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.376249 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a3206ef1-c3bc-43d5-a44d-cb3cc5528560 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/ips" status: 200 len: 147 microversion: 2.1 time: 0.085746 Aug 01 15:15:05.386059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 111/201] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:15:05 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/ips => generated 147 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:05.641263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:05.641954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:05.653505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.655784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.658299 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:05.660383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:05.803867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:05.808773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:05.817632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-177d03c0-59a9-4424-966b-ff6903d3c971 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1316 microversion: 2.1 time: 0.185672 Aug 01 15:15:05.830722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 91/202] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:05 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:06.330176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.330919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.337617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.338719 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.351044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.351591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.352454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.352996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.359823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.360636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.361619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.362266 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.690671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:06.709906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0e399b7b-c748-47df-ae66-55a74e66ca5e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.386720 Aug 01 15:15:06.711120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 92/203] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:06.803260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:06.821230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:06.823264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:06.824925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-07589eea-f68b-4163-a869-6d7490b30f53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.504819 Aug 01 15:15:06.834812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 112/204] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:06.862652 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:06.863346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:06.871860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.872420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:06.873427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:06.873867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.190925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:07.207963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-51daced8-0f70-4e68-8cae-e29ae78971f4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.360766 Aug 01 15:15:07.209169 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 93/205] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:06 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:07.749363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:07.750240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:07.759251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.760421 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.761751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.762775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.869339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:07.871505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:07.884536 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.885452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:07.887355 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:07.888480 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.013658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.033723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fe760f50-3763-417d-a27c-b6eeaf68c234 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.289673 Aug 01 15:15:08.035362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 113/206] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:07 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:08.145852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.165125 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.168917 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.171516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-29059f6c-4f7f-4d18-8956-4f65563a34fa tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.308967 Aug 01 15:15:08.172329 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 94/207] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:07 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:08.248438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:08.249815 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:08.261945 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.267788 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.269440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:08.270255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:08.525891 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:08.543561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3c195a11-ce4d-4ca3-9690-e7bbe16aa0f5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.301461 Aug 01 15:15:08.562192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 114/208] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:08 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:09.070176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.070964 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.078605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.079377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.080709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.081641 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.203180 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.205941 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.237219 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.238304 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.240176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.241316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.646396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.661598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.665671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.668358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b3860c09-4de2-48ef-8805-14e8ec9e11c7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.472023 Aug 01 15:15:09.685300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 115/209] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:09.704999 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:09.714121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:09.715970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:09.728803 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-34f86ab8-3438-43da-b1c3-2d9dcc980da7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.650656 Aug 01 15:15:09.730043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 95/210] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:09.745106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.754504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:09.755922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:09.757277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.054031 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-4cea6187-75ae-46b3-8ddc-6338f729eb35 req-57e07365-920a-4072-811f-541eef28afe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:10.156955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-4cea6187-75ae-46b3-8ddc-6338f729eb35 req-57e07365-920a-4072-811f-541eef28afe3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.159373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-4cea6187-75ae-46b3-8ddc-6338f729eb35 req-57e07365-920a-4072-811f-541eef28afe3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.182927 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.212586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d1d1baac-0c12-40ff-b266-cdf840d76f99 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.524945 Aug 01 15:15:10.213638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 116/211] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:09 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:10.227982 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-4cea6187-75ae-46b3-8ddc-6338f729eb35 req-57e07365-920a-4072-811f-541eef28afe3 service nova] Creating event network-changed:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:15:10.273330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-4cea6187-75ae-46b3-8ddc-6338f729eb35 req-57e07365-920a-4072-811f-541eef28afe3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226318 Aug 01 15:15:10.285064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 96/212] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:15:10.714205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:10.715300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:10.728607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.729195 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.730349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.730884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.789731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:10.791088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:10.803172 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.804902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.806519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:10.807406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:10.930028 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.950963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.954884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:10.957705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-02ec04ec-6447-4ec8-be7f-3a488cea0044 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.249292 Aug 01 15:15:10.960102 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 117/213] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:10 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:11.033959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.049317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d4136c3d-d7b9-4af1-812d-a3b70c5baa2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.267873 Aug 01 15:15:11.051021 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 97/214] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:10 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:11.252645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:11.253810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:11.266556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.267506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.269459 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:11.270838 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:11.506893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:11.523991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8d858e3c-59cd-4aef-aa01-294517a58cee tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.280475 Aug 01 15:15:11.525271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 118/215] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:12.001910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.002783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.014465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.015552 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.017040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.017860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.101972 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.102690 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.111927 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:12.114463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.115048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.116144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.117517 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.123798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:12.263996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=12 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:12.354444 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.390026 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.405424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.426660 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-054fceef-e032-4f20-a3b7-bd4ea26d9f7e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.412382 Aug 01 15:15:12.432604 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 98/216] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:11 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:12.455907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:12.485133 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9ca6cc31-c83a-4614-9605-d49b8cd6d218 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.411490 Aug 01 15:15:12.502626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 119/217] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:12 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:12.555515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:12.564568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:12.597357 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.598613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.600081 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:12.600976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:12.972967 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62401631-0d18-4f6a-b8f9-3f7679a96695"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:12.983339 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:13.001613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:13.014674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-697cb9ed-5a9c-4129-a382-c3ac3bd1d309 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.470340 Aug 01 15:15:13.015688 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 99/218] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:12 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:13.018594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.021658 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.026337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.029663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.477574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:13.478951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:13.489923 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.490891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:13.492571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:13.493362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.059010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.081520 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.083433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.085512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d67d5291-e18b-427d-9ba3-ac91cdf02c8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.614110 Aug 01 15:15:14.086590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 100/219] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:13 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:14.119418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:14.123940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:14.151575 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.153158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.155851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.157056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.474748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.484897 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1dbb084e-951d-4fd6-8604-d835435707c8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.396551 Aug 01 15:15:14.485679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 101/220] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:14 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:14.495689 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:14.496322 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:14.512666 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.513564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.515651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:14.517027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:14.726254 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:14.740130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-72899180-38da-40cb-bf15-e3b2219a7218 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.252601 Aug 01 15:15:14.741827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 102/221] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:14 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:15.127973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.129162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.135240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.135689 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.136494 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.136963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.352657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.362558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.364174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.365449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-908e8ba8-2407-47a3-ab0e-8548438f639b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.242319 Aug 01 15:15:15.366107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 103/222] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:15.519568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.520238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.528027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.528607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.529451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.529935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.678880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.687663 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8143b65a-aa52-4b66-81f0-9a22a5c3448c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.172050 Aug 01 15:15:15.688317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 104/223] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:15.775349 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:15.775854 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:15.783801 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.784580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.785518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:15.785961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:15.954181 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:15.963347 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b9c83ade-1c31-40f0-93c3-aa7cd969609f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.192231 Aug 01 15:15:15.963948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 105/224] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:15 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:16.402518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:16.408893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:16.433775 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.439155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.440987 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.445442 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.745253 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.760362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.762435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:16.763737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-590d3da9-7598-4138-87fb-0efb8f51e2ff tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.376025 Aug 01 15:15:16.764313 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 106/225] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:16 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:16.769672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:16.770245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:16.778586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.779129 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:16.780100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:16.780954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.156435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.170877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1c2f3c2b-3a69-4755-8f20-72f7c1426ae1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.405059 Aug 01 15:15:17.172396 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 107/226] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:16 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:17.179156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.179918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.191067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.192206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.193403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.194049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.413624 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:17.427048 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-03544b09-4c65-4b0a-bba9-e0a1bb44fde7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.252756 Aug 01 15:15:17.428094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 108/227] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:17.800614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:17.801799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:17.839530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.847549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.849141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:17.849841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:17.856372 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:18.275512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.296004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.300174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.302868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-44d8e3f2-0519-47ce-9d17-88e7122ba84a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.509908 Aug 01 15:15:18.305093 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 109/228] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:17 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:18.315264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:18.316905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:18.349389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.350103 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.352513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.353323 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.853635 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:18.885943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2976c861-d4dc-4182-9bd0-847a15805a7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.578543 Aug 01 15:15:18.894713 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 110/229] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:18 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:18.915050 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:18.917942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:18.951461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.953839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:18.990247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:18.992287 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.806952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-980bff51-aee8-428e-b7a9-f73b7c376bee tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.859972 Aug 01 15:15:19.808596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 120/230] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:15:12 2022] POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments => generated 194 bytes in 6864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:15:19.820035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:19.821747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:19.865085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.866804 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.869377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:19.870917 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:19.996743 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.006049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2f61426b-0a8d-4460-9470-cc8dba058830 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 1.109538 Aug 01 15:15:20.007877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 111/231] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:18 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:20.032736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:20.033685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:20.041748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.042490 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.043638 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:20.044434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:20.415007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.440174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.454011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.456719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-819153b0-380b-4778-bfca-8138538c40d2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.645966 Aug 01 15:15:20.473818 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 121/232] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:19 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:20.539449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:20.569807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-08f2b0ef-0a93-4db5-83dc-d64566a20972 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.560095 Aug 01 15:15:20.585841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 112/233] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:20 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:21.071530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.074022 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.089125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.090470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.092909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.094066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.515545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.518675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.539465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.554451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.556370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.565776 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.855727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:21.889863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1632d616-30c7-4dc1-8647-fa286e4039eb tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.825206 Aug 01 15:15:21.916848 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 122/234] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:21.935293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:21.942635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:21.969141 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.973705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:21.981371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:21.983001 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.574138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.597632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.602303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.604365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8b8b8132-dc51-4354-a694-bd20fbfc104e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 1.099562 Aug 01 15:15:22.627241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 113/235] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:22.724581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:22.744991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-09582788-b773-484c-a75f-9cdba4441011 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.823664 Aug 01 15:15:22.762119 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 123/236] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:21 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:22.957298 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:22.965961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:22.990838 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:22.992025 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:22.999612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.000546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.640182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:23.641585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:23.669870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.671355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:23.673201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:23.678703 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.101267 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.118880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bf5a784c-4611-4164-8626-175e5a2f521e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 1.189972 Aug 01 15:15:24.130716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 114/237] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:22 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:24.167334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:24.168612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:24.208140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.213816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.214378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.215218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:24.215661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:24.227309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.241268 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.250149 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-22725163-5209-469f-989a-843433f813f5 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.619809 Aug 01 15:15:24.269088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 124/238] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:23 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:24.821094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:24.913965 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6d27b8fe-3906-42e1-9066-d3eb03c2fa9f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.764207 Aug 01 15:15:24.933264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 115/239] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:24 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:25.147607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.148788 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.157616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.158096 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.158929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.159366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.300910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.301869 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.314005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.315426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.317034 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.317852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.364838 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.375742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8ec02ce4-63c6-4942-8bb7-5dc816b7eb09 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.232680 Aug 01 15:15:25.376743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 125/240] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:25.555031 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.573556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.577607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:25.579678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-378692a7-27af-4cc9-8805-5007d8447b8d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.286675 Aug 01 15:15:25.580518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 116/241] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:25.959966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:25.961570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:25.975054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.976150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:25.978205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:25.979630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.258187 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.269761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6de39185-5bb2-4601-8d2d-46856c4cb8b2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.316918 Aug 01 15:15:26.273064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 126/242] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:25 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:26.414772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:26.415997 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:26.424337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.425068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.426527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.427170 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.623461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:26.625680 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:26.636456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.637707 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.639409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:26.640492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:26.664231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.688149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c1143fa5-5181-44e5-9157-f9a2815d6bbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.279223 Aug 01 15:15:26.689248 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 117/243] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:26 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:26.932296 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.951562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.955163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:26.957632 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-999f3858-95f3-4c2f-94a3-18a51045ca0c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.341017 Aug 01 15:15:26.958949 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 127/244] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:26 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:27.308954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:27.310070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:27.319333 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.320063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.321145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.321752 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.539504 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:27.550423 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8892f03b-3363-4306-a7df-7111f55a4242 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.248541 Aug 01 15:15:27.551034 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 118/245] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:27 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:27.729274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:27.730168 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:27.738911 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.739282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.740115 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:27.740682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:27.992228 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:27.993441 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.000993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.001995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.002642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.003595 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.004324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.019967 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-86c245e2-198a-494b-b7a1-32fcde7c5eb8 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.297507 Aug 01 15:15:28.021165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 128/246] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:27 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:28.233466 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.247314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.250043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.251808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e417271f-cc19-4d6c-91c4-b4ee00fa5291 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.267744 Aug 01 15:15:28.253144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 119/247] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:27 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:28.588855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:28.591109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:28.613887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.615631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.617181 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:28.621817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:28.903309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:28.920143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ee236ef3-cb71-43cc-9b0e-0e9a0e63d7bb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.340508 Aug 01 15:15:28.921631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 129/248] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:28 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:29.062341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.066788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.102711 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.103907 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.105743 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.106817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.302234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.303213 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.316196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.317259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.318993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.319673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.374273 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.398858 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5ecafb4d-6479-46ae-ab83-b48dbb5011bf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.343843 Aug 01 15:15:29.412545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 120/249] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:29.536853 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.546650 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.550813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:29.554281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-261f5cc8-e75c-4ac7-b3d3-81c7ca408d6e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.259460 Aug 01 15:15:29.554991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 130/250] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:29.844167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-def3cd29-47f8-434b-9f9e-a2d4c09f3fd5 req-3ace0d55-5486-495d-b062-7e2994952d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "name": "network-vif-plugged", "status": "completed", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:29.864257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-def3cd29-47f8-434b-9f9e-a2d4c09f3fd5 req-3ace0d55-5486-495d-b062-7e2994952d4b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.865856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-def3cd29-47f8-434b-9f9e-a2d4c09f3fd5 req-3ace0d55-5486-495d-b062-7e2994952d4b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.884820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-def3cd29-47f8-434b-9f9e-a2d4c09f3fd5 req-3ace0d55-5486-495d-b062-7e2994952d4b service nova] Creating event network-vif-plugged:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:15:29.891958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-def3cd29-47f8-434b-9f9e-a2d4c09f3fd5 req-3ace0d55-5486-495d-b062-7e2994952d4b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056805 Aug 01 15:15:29.893800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 121/251] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:15:29.959197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:29.959942 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:29.967229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.968114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:29.969082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:29.969548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.250433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.260981 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c1c80d2a-a65c-44ec-b2e4-71b6b99991ad tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1503 microversion: 2.1 time: 0.305739 Aug 01 15:15:30.262237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 131/252] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:29 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:30.287685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac5e4bcd-efaf-4dcc-8516-3f5514afadd7"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:30.290878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.305869 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.306440 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.308374 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.308866 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.342173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] HTTP exception thrown: Cannot 'attach_volume' instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee while it is in vm_state rescued Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Request method failure captured: Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/os-volume_attachments HTTP/1.1 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 74 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-2vSqWBuWhaSq4AEzY4TXCnlOWyl3WITgcy8evJh2I_YwHwPgR3Wxm-f1JkEfRxcUTIwey0kbWMQrQSpWv3xau-Zy5Bn33Sc5FSDvrkKFx-uYqa3MmdrXseXKXeR6ySD-_KFOw1PV0Rx1hAbBqhbhdlMjPw9BQAhUZQ-ljrAbc20 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:15:30.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_29b33a1fb52146918d3c0bd0d23d2dfa", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 3af3a5c1c2f94e51bee936b4762dc14c Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {"volumeAttachment": {"volumeId": "ac5e4bcd-efaf-4dcc-8516-3f5514afadd7"}} Aug 01 15:15:30.348497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Cannot 'attach_volume' instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee while it is in vm_state rescued Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'server_id': '17a4af5a-02a1-4627-b6cf-6d04fa59a5ee', 'body': {'volumeAttachment': {'volumeId': 'ac5e4bcd-efaf-4dcc-8516-3f5514afadd7'}}} Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:15:30.349460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee while it is in vm_state rescued Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:15:30.350852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:15:30.352512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:15:30.352512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:15:30.352512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee while it is in vm_state rescued Aug 01 15:15:30.352512 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:15:30.357144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Returning 409 to user: Cannot 'attach_volume' instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee while it is in vm_state rescued {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:15:30.358702 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bfe78958-bb27-47dd-8da6-b057fcd44555 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077480 Aug 01 15:15:30.369665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:30.370216 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.375768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 122/253] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:15:30 2022] POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 15:15:30.377945 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.378705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.379776 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.380442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.422943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.423630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.432044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.432603 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.433541 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.434079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.525504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b0c8bebe-61d2-474d-b4a6-9da6245a6704 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/action" status: 202 len: 0 microversion: 2.1 time: 0.159642 Aug 01 15:15:30.532998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 132/254] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:15:30 2022] POST /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:15:30.546293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.547401 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.561290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.562206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.563329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.564137 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.619851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:30.714105 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.732963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2fa0bab7-dc7f-460e-946f-d573bda8c594 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.313529 Aug 01 15:15:30.736569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 123/255] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:30.748317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:30.750248 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:30.768650 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.774015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.776013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:30.777966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:30.888393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:30.903618 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce69aed1-54d4-4619-b539-0e56765f80e2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.365029 Aug 01 15:15:30.905471 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 133/256] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:31.002390 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.011355 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.013568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.014795 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e7dccad8-14d3-493e-ba22-c5dfc3a8f493 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.276394 Aug 01 15:15:31.015398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 124/257] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:30 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:31.760541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:31.761196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:31.768503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.768963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.769757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.770196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.938221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:31.939014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:31.946289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.946959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.947539 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:31.948238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:31.949811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:31.960319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-61ac57be-f8ae-44d0-95e3-04d4f7a81392 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.204133 Aug 01 15:15:31.961290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 134/258] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:31 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:32.044894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:32.046097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:32.057698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.058473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.060247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:32.061067 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:32.109733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.118712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-69c7d89e-4858-40c2-86fc-cec0e217d49f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.184582 Aug 01 15:15:32.119658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 125/259] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:31 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:32.283666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.292391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.293970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:32.295287 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-daeb5c59-93d9-475a-85bb-3fc74992be32 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.258341 Aug 01 15:15:32.295894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 135/260] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:32 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:32.995369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:32.996210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.002947 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.003385 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.004211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.004714 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.146226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.147930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.158771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.159919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.160741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.161698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:33.164567 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.165365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.169488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ae3e8cb5-e96a-4f98-b589-a746faaa6e4c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.178844 Aug 01 15:15:33.170088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 126/261] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:32 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:33.346546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:33.348338 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:33.358821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.359544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.360950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:33.361682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:33.371913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.387049 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-337ad690-8b7d-4c18-938f-b6cd424c17fb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.247979 Aug 01 15:15:33.390664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 136/262] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:33.562641 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.572631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.574259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:33.575496 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-79300919-628e-4431-8d6c-8eaaceaa0e27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.236782 Aug 01 15:15:33.576080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 127/263] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:33 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:34.191628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.192483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.195495 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=58 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:34.203793 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.204648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.205833 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.206540 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.388069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.397408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-db8ac46e-7183-4f48-8079-dd570daf7f0d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.209288 Aug 01 15:15:34.406340 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 137/264] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:34.415695 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.417410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.428688 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.429458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.431078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.431828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.604325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:34.605396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:34.614346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.615197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.616005 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:34.616579 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:34.662846 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.671834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-216e79cf-1bc4-4688-8b3d-2ae811e5ba62 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.263189 Aug 01 15:15:34.672418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 128/265] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:34.785243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.795515 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.797523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:34.798970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4dcc46c4-175c-42f9-a81c-fbdf3284b820 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.202373 Aug 01 15:15:34.799742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 138/266] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:34 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:35.429618 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:35.430515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:35.432490 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=78 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:35.439523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.440132 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.441076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.441638 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.657331 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:35.673017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-426d4130-3346-4b4e-bc23-f6c99f5af3c4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.247427 Aug 01 15:15:35.674112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 129/267] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:35 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:35.701965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:35.703524 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:35.712866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.713391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.714258 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.714749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.829613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:35.830799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:35.842997 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.843773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.845205 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:35.846018 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:35.924129 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:35.938227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-611fe45a-1793-48cf-b443-c6ac518a029c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.241639 Aug 01 15:15:35.938857 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 139/268] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:35 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:36.083564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.094826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.096818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.098291 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2cc7a2c9-95e9-48f0-be2f-c4959a9b7c9b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.276403 Aug 01 15:15:36.098985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 130/269] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:35 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:36.699712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:36.700683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:36.708164 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.709045 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.709416 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.709874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.918162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:36.927292 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-166a8042-3b3e-4183-ac28-daf55f01f06c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.231684 Aug 01 15:15:36.927895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 140/270] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:36 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:36.964552 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:36.965266 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:36.972561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.973063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:36.973919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:36.974392 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.127548 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.129919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.142630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.143461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.145386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.146391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.179553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.192340 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-68a6615d-4ca8-4cd6-a875-6f6141274d3f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.231672 Aug 01 15:15:37.196553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 131/271] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:36 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:37.359515 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.370021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.371576 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:37.372861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-132b4053-558d-4a75-8d58-72d7b11e7b7c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1744 microversion: 2.20 time: 0.252579 Aug 01 15:15:37.373461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 141/272] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:37.952730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:37.953932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:37.966072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.966972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:37.967882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:37.968775 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.230304 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.231008 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.251148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.251601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.252605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.252978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.564391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.598066 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cc3ce051-5d9f-4f00-8376-fcff5fdacb4b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.650613 Aug 01 15:15:38.626537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 132/273] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:37 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:38.636129 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:38.642145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:38.664339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.667276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.669154 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:38.673826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.675728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:38.683276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-88e221fb-6deb-42df-aeee-fc1587511593 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.456540 Aug 01 15:15:38.684511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 142/274] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:38.690828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2e44b9ff-55e5-4d11-88a2-9db62d84c037 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:38.700714 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e44b9ff-55e5-4d11-88a2-9db62d84c037 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:38.701459 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2e44b9ff-55e5-4d11-88a2-9db62d84c037 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.047414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2e44b9ff-55e5-4d11-88a2-9db62d84c037 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Going to try to stop instance {{(pid=117993) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:15:39.212356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2e44b9ff-55e5-4d11-88a2-9db62d84c037 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action" status: 202 len: 0 microversion: 2.1 time: 0.526299 Aug 01 15:15:39.213577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 143/275] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:15:38 2022] POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:15:39.231090 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.234339 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.245350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.246285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.250464 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.253507 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.346642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.376614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.383639 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.390070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f3bb843b-9716-4bf9-a26d-fd495060f853 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.760798 Aug 01 15:15:39.390568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 133/276] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:38 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:39.649951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.651110 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.700793 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.710727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.720044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.727089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.806455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:39.844060 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-31c81796-7553-4790-a639-21e3a6900814 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.617650 Aug 01 15:15:39.845292 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 144/277] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:39.867017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:39.873810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:39.898093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.905869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:39.907642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:39.911335 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.492641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:40.534370 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9649e358-e7b9-40e5-9f73-c1945714990a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.684250 Aug 01 15:15:40.543059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 145/278] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:40.576498 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:40.579170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:40.625733 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.628344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.632264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.636363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.724367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:40.785749 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fc87181f-576f-44fa-86f5-e0a259044a6f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 1.143664 Aug 01 15:15:40.787841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 134/279] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:39 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:40.896892 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:40.898146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:40.945965 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.955032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:40.959534 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:40.960415 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.075732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.109101 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.113925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.117294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e2234e7f-1557-4b6f-bfc0-2887d68c94e9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.571656 Aug 01 15:15:41.134215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 146/280] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:40 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:41.352160 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:41.384611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b96a47cf-2c27-4265-87f2-599c0bfb3b78 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.499356 Aug 01 15:15:41.386588 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 135/281] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:40 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:41.579935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:41.581112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:41.611095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.611095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.612700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.613308 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.844807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:41.844807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:41.876787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.877271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:41.878430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:41.879064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.133624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.219239 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2cf00b09-c89c-445e-84cd-2d20ebb636a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1511 microversion: 2.1 time: 0.622722 Aug 01 15:15:42.221075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 147/282] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:41 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:42.230640 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.231638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.244695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.245529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.247068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.248039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.406627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.421954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a13dc5b1-3f52-4637-9ada-c668948199ae tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.595948 Aug 01 15:15:42.422588 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 136/283] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:41 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:42.464342 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:42.465956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:42.481317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.481863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.483013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:42.483522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:42.869583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.943897 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.957962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:42.999573 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d7c1cf5c-6481-4e87-b848-79c6e7641c59 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.765647 Aug 01 15:15:43.003123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 148/284] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:43.045774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-99a87deb-7c72-4fed-9cd5-b1fa0c7119b2 req-3c1922c1-2a8d-476c-9a27-1c2238542ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "name": "network-vif-plugged", "status": "completed", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:43.098899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-99a87deb-7c72-4fed-9cd5-b1fa0c7119b2 req-3c1922c1-2a8d-476c-9a27-1c2238542ef9 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.102254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-99a87deb-7c72-4fed-9cd5-b1fa0c7119b2 req-3c1922c1-2a8d-476c-9a27-1c2238542ef9 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.103323 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.129351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0dbd430c-eaf8-400a-a9e1-b68ff4d2e9c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.691518 Aug 01 15:15:43.133453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 137/285] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:42 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:43.158679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:43.166239 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-99a87deb-7c72-4fed-9cd5-b1fa0c7119b2 req-3c1922c1-2a8d-476c-9a27-1c2238542ef9 service nova] Creating event network-vif-plugged:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:15:43.196879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-99a87deb-7c72-4fed-9cd5-b1fa0c7119b2 req-3c1922c1-2a8d-476c-9a27-1c2238542ef9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180771 Aug 01 15:15:43.196879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 149/286] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:43.255000 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.256899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.271873 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.276064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.280154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.282373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.468603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:43.483819 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:43.566415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.567394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.581134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:43.582762 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:43.779705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:43.803065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-723e2b62-dd5d-41a4-b864-6685cc70576e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1517 microversion: 2.1 time: 0.552989 Aug 01 15:15:43.833691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 138/287] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:44.028598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.078057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8a3e23c7-ad7e-451c-9c4b-4e187099d38c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.621016 Aug 01 15:15:44.079173 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 150/288] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:43 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:44.121855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.123107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.135010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.136245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.138076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.139232 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.169103 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:44.171273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:44.195798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.225885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.234433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:44.242388 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:44.720723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.751058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.778805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.784882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8f52501e-1b6f-4dc7-85ac-ee0f0a2bae8a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.675764 Aug 01 15:15:44.787630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 139/289] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:44.814472 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:44.848039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0888d0dc-5f2c-4be1-9829-06a8f583b530 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.685503 Aug 01 15:15:44.861631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 151/290] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:44 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:45.135205 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:45.180304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:45.204648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.205802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.211255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.213258 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.477214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:45.519635 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e8a4b981-fb2c-418e-be3d-143a58de9505 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1358 microversion: 2.1 time: 0.405151 Aug 01 15:15:45.527237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 140/291] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:45 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:45.715373 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a714e06d-e524-4c42-aa6f-004c506e0721 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: .version_select at 0x7fc9ecab9280>, body: {"keypair": {"name": "tempest-keypair-1944780468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdInuwQ+d2tRzulhP5/nosNbVCU7o8iiZSBw4MC3ZDZzUQ9ubGwhd6OiUJwnLBDCW3JgwYi7fNG2BfgHiz8UIanQbtSqON0WDY+PU0Wuwb6B2UuHAp/SWIDLfbDkvfF1A=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:45.752416 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-a714e06d-e524-4c42-aa6f-004c506e0721 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:15:45.761888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-a714e06d-e524-4c42-aa6f-004c506e0721 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for user 3af3a5c1c2f94e51bee936b4762dc14c and project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:15:45.802285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a714e06d-e524-4c42-aa6f-004c506e0721 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091863 Aug 01 15:15:45.824136 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 152/292] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:15:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:45.840178 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:45.842961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:45.867130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.870968 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.874059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.875121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.905429 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:45.907305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:45.937772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.950688 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:45.957242 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:45.961180 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.364549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.416154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.422016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.429082 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1cae8e95-4ff8-453e-b413-bcf229a3336c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.607986 Aug 01 15:15:46.432865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 141/293] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:45 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:46.563418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:46.564994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:46.571221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:46.583967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.587007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.606678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:46.608004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:46.611975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0a48ad56-71a4-4e70-bcd4-425232b575ca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.722935 Aug 01 15:15:46.623395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 153/294] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:45 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:47.062128 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:47.079673 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a3834bc4-c0d0-4588-927a-69aea3779232 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1547 microversion: 2.1 time: 0.526385 Aug 01 15:15:47.081583 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 142/295] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:46 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1547 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:47.127297 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.138074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.162064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.165393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.166764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.167469 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.533774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:47.537382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:47.552056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.553495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.556518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:47.557410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:47.609039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:47.986377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.031304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.044514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.048004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e4b6c01d-64c8-4dbc-a0c8-c2dd21fb23b8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.567258 Aug 01 15:15:48.050180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 143/296] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:48.061079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.062565 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.091188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.095370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.101130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.102739 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.167062 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.218143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d1e095c2-0117-4093-bd66-ec45a81b09d1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1547 microversion: 2.1 time: 1.100381 Aug 01 15:15:48.221097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 154/297] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:47 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1547 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:48.258176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.277754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.279119 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Searching by: {'deleted': False, 'project_id': '03ff255ce0464ad49313432927bb4daf'} {{(pid=117993) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 15:15:48.305091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.305808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.316838 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.317583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.595725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:48.617024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b02a1733-1198-48e7-ab1b-eb57caafbb6b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.564248 Aug 01 15:15:48.618160 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 144/298] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:48.619858 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.multi_cell_list [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 15:15:48.899698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6693772f-c424-42b8-807f-bb9d3f61751d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.655204 Aug 01 15:15:48.901614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 155/299] 10.222.0.93 () {58 vars in 1125 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:15:48.934877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:48.936871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:48.971218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.982521 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:48.987218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:48.988042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.111424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.120232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.144448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.145337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.148166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.151730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.619739 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:49.675012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-98c7e567-83f6-4051-87ba-3905dcd381f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1547 microversion: 2.1 time: 0.741226 Aug 01 15:15:49.678763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 145/300] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:48 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1547 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:49.710935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:49.715283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:49.737392 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.740197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:49.742365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:49.743451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:50.104281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.136869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.139854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.142126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7030eb5e-8cae-4d90-9cc7-22789fcd9210 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 1.038810 Aug 01 15:15:50.172124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 156/301] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:50.342487 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:50.364001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-74ded072-989f-463a-9fef-c7c2470390a7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.682910 Aug 01 15:15:50.366195 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 146/302] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:49 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:51.219121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:51.220121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:51.221004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-485429296", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "293a9d7f-74cf-4225-a1b0-44acc0b59f1f"}], "security_groups": [{"name": "tempest-securitygroup--275352510"}], "key_name": "tempest-keypair-1944780468", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:51.232151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.232933 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.235671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.236811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.656244 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.682715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.687032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:51.689617 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9d202751-52d1-4a3c-9937-144ae621aa45 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.478575 Aug 01 15:15:51.699936 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 157/303] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:51 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:51.727568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:51.728502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:51.739932 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.740798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:51.742235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:51.742984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.121018 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:52.200179 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b86f619d-4d57-4520-86ba-5eb488093bd4 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.497742 Aug 01 15:15:52.201953 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 158/304] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:51 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:52.622865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] validate_networks() for [('293a9d7f-74cf-4225-a1b0-44acc0b59f1f', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:15:52.745659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:52.747078 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:52.796924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.797749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:52.799196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:52.799956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.194809 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:53.219678 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:53.221484 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:53.222833 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4b2d7cba-913f-4040-a7cc-939a72dda7a4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.489357 Aug 01 15:15:53.240034 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 159/305] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:52 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:53.246560 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53a784ab-8778-4373-aced-d9699b98e9ca"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:15:53.249504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:53.266960 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.267418 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.268430 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.268968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.605998 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:15:53.607174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:15:53.608537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:15:53.609536 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:15:53.611452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:15:53.658018 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.661463 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.666708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.667846 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.713574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:15:53.726378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Getting quotas for user 3af3a5c1c2f94e51bee936b4762dc14c and project 29b33a1fb52146918d3c0bd0d23d2dfa. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:15:53.752617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:15:53.758445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:15:53.919523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d8003bd1-dba5-4104-ad8c-ff254712f457 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.706334 Aug 01 15:15:53.922867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 147/306] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:15:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 2711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:15:53.934403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:53.939482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:53.954396 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.955442 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:53.956700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:53.957456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.042261 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4270fa81-34e2-48d2-bc47-d7b41d9e0cbd tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805970 Aug 01 15:15:54.069162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 160/307] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:15:53 2022] POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:15:54.092196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5f26bbe9-1322-4140-b9bc-d490320958b9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:54.093948 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5f26bbe9-1322-4140-b9bc-d490320958b9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:54.260232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5f26bbe9-1322-4140-b9bc-d490320958b9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.275084 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5f26bbe9-1322-4140-b9bc-d490320958b9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1245 microversion: 2.1 time: 0.203271 Aug 01 15:15:54.278616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 161/308] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:54 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:54.305326 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:54.306377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:54.315005 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.315556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.316423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:54.316904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:54.428807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.468835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6ae83425-2a4f-44a3-958b-ee9437308ee0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.539525 Aug 01 15:15:54.470238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 148/309] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:53 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:54.597407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.619085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.622666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:54.624727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ce64f51f-3444-41f0-a799-2339c0264da9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.343420 Aug 01 15:15:54.627001 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 162/310] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:54 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:55.318022 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.323313 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.365371 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.386687 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.407557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.408684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.511938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.519894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.538166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.539064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.540251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.540921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.592376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.613585 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-856ddcf5-c453-4c69-9ec0-20b17922aeda tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1297 microversion: 2.1 time: 0.304076 Aug 01 15:15:55.616136 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 149/311] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1297 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:55.664906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:55.673916 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:55.692452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.694672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.698201 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:55.699697 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:55.884887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:55.898091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-41025e76-9798-4809-b004-2a5b49c2705c tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.409405 Aug 01 15:15:55.900190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 163/312] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:56.496072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.537010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.538808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.554190 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-448d4db5-7db6-4ad9-b70a-7855d1f5b13b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.891309 Aug 01 15:15:56.554906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 150/313] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:55 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:15:56.658535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.660585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.673511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.674979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.677442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.678925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.810902 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:56.830376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e57342a3-6403-4013-8739-570990e2c410 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1303 microversion: 2.1 time: 0.178079 Aug 01 15:15:56.831782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 164/314] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1303 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:56.941827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:56.943815 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:56.958207 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.959890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:56.961511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:56.962218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.389458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:57.422272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f83c094a-99b4-4f88-baf6-8e7663579c7d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.485432 Aug 01 15:15:57.425223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 151/315] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:56 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:15:57.582747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.585167 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.594234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.595256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.596812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.597661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.872535 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:57.875530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:57.909318 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.910966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.914067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:57.915103 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:57.987974 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.006643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.010687 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.016924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2a269f84-8798-48ea-b238-b9527900256f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.440527 Aug 01 15:15:58.017967 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 165/316] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:15:58.468364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:58.472951 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:58.499749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:58.503990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.510289 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.512159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:58.518503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:58.533588 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.550821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f203d70e-f7d7-4a04-bdb3-26bc4da48122 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.685720 Aug 01 15:15:58.563300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 152/317] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:57 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:58.869864 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:15:58.873062 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:15:58.893558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d6a1ad19-d8f0-4feb-8848-96b2251d0b63 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1724 microversion: 2.1 time: 0.433724 Aug 01 15:15:58.910699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 166/318] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:58 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:15:59.064514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:59.065624 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:59.092704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.096227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.098350 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.103279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.595041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:15:59.599722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:15:59.630740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.631942 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:15:59.636918 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:15:59.640982 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.158039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.190602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3fd2e53e-b535-445d-a991-43d30dcd1aa0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.604244 Aug 01 15:16:00.193573 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 167/319] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:15:59 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:00.234428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:00.237447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:00.270271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.279891 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.283552 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.287003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.440118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.467241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.471439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.473427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3b48b8b5-5fff-4231-857c-5e5e59d7492d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 1.416760 Aug 01 15:16:00.475158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 153/320] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:15:59 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:00.573873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:00.600408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-41ffacd0-8923-4bf4-85b9-f40b469e9df1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1701 microversion: 2.1 time: 0.404675 Aug 01 15:16:00.601998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 168/321] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:00 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1701 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:00.638106 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-73fedd2c-5240-4f34-a89d-28aed39ef543 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:00.651007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-73fedd2c-5240-4f34-a89d-28aed39ef543 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.651861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-73fedd2c-5240-4f34-a89d-28aed39ef543 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.774683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-73fedd2c-5240-4f34-a89d-28aed39ef543 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Going to try to start instance {{(pid=117992) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:16:00.917016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-73fedd2c-5240-4f34-a89d-28aed39ef543 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action" status: 202 len: 0 microversion: 2.1 time: 0.281919 Aug 01 15:16:00.924077 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 154/322] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:16:00 2022] POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:16:00.930696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:00.932018 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:00.940545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.941526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:00.943209 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:00.944300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.268413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:01.273864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:01.314988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.315823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.317989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.318671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.449812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:01.517065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5da2b410-4d26-4364-8876-d5c69215446d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1710 microversion: 2.1 time: 0.590964 Aug 01 15:16:01.517962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 169/323] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:00 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1710 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:01.535069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-01742221-c5e8-4a94-a6fb-5c7eac7c742c req-f4288fa5-ec0a-4f6b-a45e-5d5843fa9045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:01.609561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-01742221-c5e8-4a94-a6fb-5c7eac7c742c req-f4288fa5-ec0a-4f6b-a45e-5d5843fa9045 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.612107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-01742221-c5e8-4a94-a6fb-5c7eac7c742c req-f4288fa5-ec0a-4f6b-a45e-5d5843fa9045 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.652040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-01742221-c5e8-4a94-a6fb-5c7eac7c742c req-f4288fa5-ec0a-4f6b-a45e-5d5843fa9045 service nova] Creating event network-changed:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:16:01.704060 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-01742221-c5e8-4a94-a6fb-5c7eac7c742c req-f4288fa5-ec0a-4f6b-a45e-5d5843fa9045 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177905 Aug 01 15:16:01.708608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 170/324] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:01.732113 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:01.734985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:01.768284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.769179 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:01.770906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:01.780885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.220504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.232570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.234879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.236595 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e3725aec-b9b0-43b5-b912-8fc397142790 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1739 microversion: 2.20 time: 0.523445 Aug 01 15:16:02.249353 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 171/325] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:01 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1739 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:02.265980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:02.266613 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:02.277839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.278692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.280213 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.281240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.441161 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.458865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9748da7f-a31b-476e-b837-0f4c11ed2e7c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 1.228396 Aug 01 15:16:02.460777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 155/326] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:01 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:02.547607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:02.548826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:02.560317 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.561169 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.562918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:02.564034 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:02.599933 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:02.613824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ec73717e-8b6e-4e95-91c1-da08351510b2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1593 microversion: 2.1 time: 0.363422 Aug 01 15:16:02.615764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 172/327] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:02 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1593 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:03.272446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:03.273266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:03.282187 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.282663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.283473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.283917 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.509851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:03.524600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:03.535015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:03.538092 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9972b0bb-5e97-4d45-a710-f5818b2c53ea tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1710 microversion: 2.1 time: 0.997065 Aug 01 15:16:03.539323 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 156/328] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:02 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1710 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:03.546068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:03.548041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:03.556322 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:03.564062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.565348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.566578 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:03.568034 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:03.570100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-abedc479-8c5f-4dda-8134-7eff6a38f1e8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1721 microversion: 2.20 time: 0.302647 Aug 01 15:16:03.572521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 173/329] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:03 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:03.688396 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:03.742124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:04.261663 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.280722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-765c1275-e5a6-4e4b-8ce7-3f4da77bf37d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.739333 Aug 01 15:16:04.282343 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 157/330] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:03 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:04.577127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:04.578440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:04.581983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:04.584612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:04.595368 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.596112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.597539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.599507 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.610757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:04.611927 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:04.630746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.634540 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.639463 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:04.642551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:04.888733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.904865 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.908845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.911825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ffca7420-90ae-45f7-8693-5b54b87b3a8f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1721 microversion: 2.20 time: 0.306500 Aug 01 15:16:04.913694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 158/331] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:04 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:04.944009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:04.954223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b25b8b84-8ecf-44ff-8cbd-0966fc7fd83a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1710 microversion: 2.1 time: 0.382434 Aug 01 15:16:04.955588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 174/332] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:04 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1710 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:05.309868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:05.311403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:05.331039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.333595 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.338431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.339323 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.942255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:05.943731 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:05.966004 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.967318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:05.970098 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:05.971274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.320929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.330080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:06.340268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-451df442-cc3b-4666-8813-00bacb5a1277 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 1.033716 Aug 01 15:16:06.344282 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 159/333] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:05 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:06.357696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:06.360413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:06.365202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:06.386857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.388320 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.393664 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.395772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.632334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:06.658009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1c8e17d7-f82d-47bd-bab6-595df8f74c73 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1710 microversion: 2.1 time: 0.311601 Aug 01 15:16:06.659819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 160/334] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:06 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1710 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:06.669800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-204696d9-8c3e-48bc-9721-2ede25c42564 req-f86ba93a-00b9-491e-8813-1c1d5db46249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "name": "network-vif-unplugged", "status": "completed", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:06.689307 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-204696d9-8c3e-48bc-9721-2ede25c42564 req-f86ba93a-00b9-491e-8813-1c1d5db46249 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:06.690537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-204696d9-8c3e-48bc-9721-2ede25c42564 req-f86ba93a-00b9-491e-8813-1c1d5db46249 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:06.708239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-204696d9-8c3e-48bc-9721-2ede25c42564 req-f86ba93a-00b9-491e-8813-1c1d5db46249 service nova] Creating event network-vif-unplugged:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:16:06.718376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-204696d9-8c3e-48bc-9721-2ede25c42564 req-f86ba93a-00b9-491e-8813-1c1d5db46249 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055399 Aug 01 15:16:06.719587 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 161/335] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:07.118717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.138277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.146044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.149916 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c6686cc5-c19b-49bb-9017-42e4123e617c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1721 microversion: 2.20 time: 1.213835 Aug 01 15:16:07.152782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 175/336] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:05 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1721 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:07.283932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-7c36653c-ef81-4278-8854-966de7093067 req-145c2c53-f629-40f5-879e-4331a31e5b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:07.316409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-7c36653c-ef81-4278-8854-966de7093067 req-145c2c53-f629-40f5-879e-4331a31e5b76 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.317430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-7c36653c-ef81-4278-8854-966de7093067 req-145c2c53-f629-40f5-879e-4331a31e5b76 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.350620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-7c36653c-ef81-4278-8854-966de7093067 req-145c2c53-f629-40f5-879e-4331a31e5b76 service nova] Creating event network-changed:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:16:07.359435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-7c36653c-ef81-4278-8854-966de7093067 req-145c2c53-f629-40f5-879e-4331a31e5b76 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084412 Aug 01 15:16:07.361565 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 162/337] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:07.385614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.387605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.405154 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.406305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.408210 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.410291 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.702402 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:07.709138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:07.744816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.746079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.754221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:07.756091 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:07.810877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:07.837497 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-00e43701-5dc9-44f1-9dd3-9eec707cf01b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.460650 Aug 01 15:16:07.839519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 176/338] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:08.191735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.197520 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.225197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.235331 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.238491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.240146 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.261455 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.284853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3cf9eac5-cc5f-4bff-a993-0dc70ba9f7e9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1714 microversion: 2.1 time: 0.601233 Aug 01 15:16:08.327844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 163/339] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:07 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1714 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:08.695700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.717008 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.722534 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:08.726430 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4a8b8ecc-8725-43ae-b8c6-e2f28820d8d0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1721 microversion: 2.20 time: 0.541126 Aug 01 15:16:08.740994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 177/340] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1721 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:08.872450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:08.873260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:08.894887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.896065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:08.896941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:08.897523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.439238 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-baafa370-e428-4472-84d0-d870cc184b69 req-605267fe-e93d-4d17-b8d2-a39559e10c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "name": "network-vif-plugged", "status": "completed", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:09.466817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-baafa370-e428-4472-84d0-d870cc184b69 req-605267fe-e93d-4d17-b8d2-a39559e10c4b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.468390 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-baafa370-e428-4472-84d0-d870cc184b69 req-605267fe-e93d-4d17-b8d2-a39559e10c4b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.530572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:09.541701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-baafa370-e428-4472-84d0-d870cc184b69 req-605267fe-e93d-4d17-b8d2-a39559e10c4b service nova] Creating event network-vif-plugged:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:16:09.552404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-82329218-a774-41e7-81a3-c04742260d7f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.685156 Aug 01 15:16:09.556264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 164/341] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:08 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:09.567964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-baafa370-e428-4472-84d0-d870cc184b69 req-605267fe-e93d-4d17-b8d2-a39559e10c4b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129044 Aug 01 15:16:09.571902 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 178/342] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:09.790979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:09.795902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:09.834950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.841969 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:09.849528 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:09.855667 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.587416 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:10.588743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:10.626256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.627231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.628778 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.629631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.691009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.714223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.717330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:10.733239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-65ef7e8b-03ea-4ade-b7e4-236d4027a1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1664 microversion: 2.20 time: 0.957872 Aug 01 15:16:10.736834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 165/343] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:09 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1664 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:10.798262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca9d8117-f82f-4fee-855f-658bb9f89441"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:10.803126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:10.815047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.816499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:10.818203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:10.819109 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.144690 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:11.159766 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-86264f0c-cff2-479d-90c4-ed7dc7261422 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.580809 Aug 01 15:16:11.164841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 179/344] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:10 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:11.432835 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-502218870"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:11.433601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.450656 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.451170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.453122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.453797 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.599695 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-38b999bd-ab1b-4e1c-8e79-73eaba22f344 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.807993 Aug 01 15:16:11.601831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 166/345] 10.222.0.93 () {62 vars in 1364 bytes} [Mon Aug 1 15:16:10 2022] POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments => generated 188 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:16:11.788505 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.network.security_group_api [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Adding security group cc6a7fdc-1e94-4243-9e0e-c3bcda0ee6c8 to port 87b90173-3201-499e-b0ba-c81666855480 Aug 01 15:16:11.899499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:11.901648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:11.912960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.913636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:11.914700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:11.915722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.022845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117992) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:16:12.201894 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8448e78c-8513-42d2-ac29-5eca997ce86f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/action" status: 202 len: 0 microversion: 2.20 time: 0.309519 Aug 01 15:16:12.203549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 167/346] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Aug 1 15:16:11 2022] POST /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:16:12.213346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.214495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:12.226695 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.227545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.229162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.233511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.783736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:12.811304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3d5796cb-01ce-40fe-8e3a-c4d629cd39d3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1370 microversion: 2.1 time: 0.605500 Aug 01 15:16:12.814254 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 168/347] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1370 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:12.846498 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:12.848144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:12.874456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.875216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:12.876644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:12.877506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.085160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-754e6584-c2f9-45e0-97cf-8fbe0dbcee05 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action" status: 202 len: 0 microversion: 2.1 time: 1.656477 Aug 01 15:16:13.085160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 180/348] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:16:11 2022] POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action => generated 0 bytes in 1660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:16:13.105013 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.117223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:13.142646 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.144160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.148309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.153251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.469320 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.519403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.524113 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.526661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-17ef95b4-49a5-4cf8-8e91-28e947d3e42e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1750 microversion: 2.20 time: 0.709832 Aug 01 15:16:13.545165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 169/349] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:12 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1750 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:13.573015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-bdd4555b-a02a-47a0-b2dc-fcfb0587e82e req-b8795998-20d8-4a4f-984b-cc5f5de1c61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:13.596428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-bdd4555b-a02a-47a0-b2dc-fcfb0587e82e req-b8795998-20d8-4a4f-984b-cc5f5de1c61c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.597674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-bdd4555b-a02a-47a0-b2dc-fcfb0587e82e req-b8795998-20d8-4a4f-984b-cc5f5de1c61c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.623840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-bdd4555b-a02a-47a0-b2dc-fcfb0587e82e req-b8795998-20d8-4a4f-984b-cc5f5de1c61c service nova] Creating event network-changed:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:16:13.634582 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-bdd4555b-a02a-47a0-b2dc-fcfb0587e82e req-b8795998-20d8-4a4f-984b-cc5f5de1c61c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087014 Aug 01 15:16:13.636100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 170/350] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:13.793425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:13.822922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b57aef26-eab7-4af3-83ca-4b2b28633dc7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1758 microversion: 2.1 time: 0.730983 Aug 01 15:16:13.841605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 181/351] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1758 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:13.871586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:13.873802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:13.901287 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.902523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:13.904830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:13.905654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.492207 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:14.521406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d2b63517-960a-4641-b063-9c73f91b11c2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1565 microversion: 2.1 time: 0.663141 Aug 01 15:16:14.533045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 171/352] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:13 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1565 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:14.580567 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:14.582094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:14.583102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.584089 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:14.605509 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.606418 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.607468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.607606 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.609900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.610692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.611516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:14.612447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:14.823447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a9cbc7e4-372e-46a3-a2e6-6baa6ff6eb6e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254210 Aug 01 15:16:14.826636 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 182/353] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:16:14 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:15.235032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.263355 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.265951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:15.267746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-159e557b-4874-43c5-94fe-bcce1af6c7a9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1750 microversion: 2.20 time: 0.694621 Aug 01 15:16:15.288864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 172/354] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:14 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1750 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:16.320672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:16.323026 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:16.339507 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.349938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:16.351676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:16.352931 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.224965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.244528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.247875 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:17.252063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-de0ea93e-b9eb-488d-a78f-96b8100594f1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1750 microversion: 2.20 time: 0.939378 Aug 01 15:16:17.253583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 183/355] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:16 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1750 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:17.685406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-3d1a7809-4cb3-4a2f-b4f9-b6236c80839c req-6180ea13-cb47-4359-a210-f0a99ce54126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:17.710648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-3d1a7809-4cb3-4a2f-b4f9-b6236c80839c req-6180ea13-cb47-4359-a210-f0a99ce54126 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:17.711549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-3d1a7809-4cb3-4a2f-b4f9-b6236c80839c req-6180ea13-cb47-4359-a210-f0a99ce54126 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:17.735863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-3d1a7809-4cb3-4a2f-b4f9-b6236c80839c req-6180ea13-cb47-4359-a210-f0a99ce54126 service nova] Creating event network-changed:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:16:17.748047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-3d1a7809-4cb3-4a2f-b4f9-b6236c80839c req-6180ea13-cb47-4359-a210-f0a99ce54126 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072400 Aug 01 15:16:17.749686 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 173/356] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:18.298027 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:18.299222 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:18.314153 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.314875 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.316446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:18.317346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:18.602578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.620223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.623894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:18.626679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9bfe42f3-9547-475c-9344-e4039782dbc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1752 microversion: 2.20 time: 0.336336 Aug 01 15:16:18.633769 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 184/357] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:18 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1752 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:19.675730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:19.678241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:19.692020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.693021 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:19.694718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:19.695605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:20.127972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:20.158164 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:20.162148 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:20.164634 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bdab25c2-c240-4e05-abd7-2fb1006f6edd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1752 microversion: 2.20 time: 0.498641 Aug 01 15:16:20.180609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 174/358] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:19 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1752 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:21.220646 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:21.222832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:21.239643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.240286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.242279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:21.243303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:21.275659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:21.549290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.570382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.574463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:21.577204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7c74d084-3f1a-4754-aad1-0568aba0de27 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.360895 Aug 01 15:16:21.578602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 185/359] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:21 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:22.631231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:22.633890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:22.647569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.648806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.650710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:22.651864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:22.708904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:22.951527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.976616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.980121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:22.982917 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0ec84bd3-3a16-4514-9685-c2e44d979f15 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.371563 Aug 01 15:16:22.984360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 175/360] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:22 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:24.028122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:24.030421 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:24.054577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.059903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.062206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:24.066514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:24.618634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.636737 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.640972 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:24.644356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-525d0f5f-10d0-4976-be1f-047bf94ca903 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.624191 Aug 01 15:16:24.662363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 186/361] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:24 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:25.302726 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:16:25.303243 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Mon Aug 1 15:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:16:25.691960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:25.693706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:25.704751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.705911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:25.708024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:25.708945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:26.251513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.282040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.285061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:26.287574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9c1d76b8-f1f7-42aa-9f1f-5c92350441ac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.602561 Aug 01 15:16:26.291916 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 176/362] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:25 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:27.340404 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:27.343703 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:27.370499 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.372390 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:27.374828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:27.376204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:28.523944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.560680 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.566521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:28.575921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7a2a00b0-085d-4855-ba41-4f951e3033e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 1.246758 Aug 01 15:16:28.582601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 187/363] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:27 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:29.632134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:29.633910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:29.684573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.688525 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:29.694310 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:29.697417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:30.655763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.713141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.732202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:30.737364 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2a8b8ce0-61e5-4796-ac87-93c8d6bf902c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 1.114672 Aug 01 15:16:30.742089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 177/364] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:29 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:31.791880 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:31.795374 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:31.826714 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.827924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:31.829461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:31.830251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:32.435160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.479186 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.501311 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:32.507739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7cdf793c-5372-4e9f-bdbd-2fa8c08b8ed9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.726410 Aug 01 15:16:32.515590 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 188/365] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:31 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:33.555264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:33.560514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:33.580896 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.581784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:33.583369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:33.584229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:34.617233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:34.673686 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:34.677656 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:34.680286 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-34f265d5-9f6f-4f04-a933-69c5b8631289 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 1.133589 Aug 01 15:16:34.681398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 178/366] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:33 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:35.716323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:35.718664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:35.742756 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=30 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:35.750559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.758712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:35.763221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:35.763934 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:36.759917 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.788543 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.794667 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:36.801708 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6d96db2a-820f-4de9-9cfd-8784538e304b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 1.091955 Aug 01 15:16:36.813202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 189/367] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:35 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:37.848633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:37.854751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:37.893621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:37.900418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.902288 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:37.903457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:37.905258 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:38.455523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:38.485611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:38.488654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:38.514250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0fddd192-2d4c-4a13-9079-808479c22d80 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.674074 Aug 01 15:16:38.522871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 179/368] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:37 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:39.569572 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:39.572068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:39.602906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.603673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:39.605260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:39.607148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.029297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:40.038957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:40.061918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.063321 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.065984 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.068263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.216847 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:40.240670 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:40.247578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:40.252648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e219e43c-1d4b-40c3-9182-5f5156a9d59f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.699979 Aug 01 15:16:40.253939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 190/369] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:39 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:40.278397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8f852979-4770-4c11-90d0-83234bd9f373 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action" status: 202 len: 0 microversion: 2.1 time: 0.268886 Aug 01 15:16:40.281731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 180/370] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:16:40 2022] POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:16:40.301411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:40.304682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:40.333044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.333642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.335241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:40.335800 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:40.972162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:41.010131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5a6eb48a-68f0-41c6-a588-791bf86f601a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1750 microversion: 2.1 time: 0.721229 Aug 01 15:16:41.037979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 191/371] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:40 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1750 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:41.289672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:41.298621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:41.338994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.340144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:41.357200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:41.357904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:42.044697 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:42.048566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:42.088311 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:42.091491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:42.096850 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:42.100886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:42.127620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:42.191432 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:42.210071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:42.212506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b48a44f7-39f2-4c5b-9c68-d8ec6796161a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.931197 Aug 01 15:16:42.226481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 181/372] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:41 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:42.799312 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:42.827558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fb6275e4-6fca-49cc-97cd-9a8b28544144 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1750 microversion: 2.1 time: 0.790473 Aug 01 15:16:42.829172 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 192/373] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:42 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1750 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:43.052155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-277fdb27-184e-43e6-af65-ffeefd74d4d4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Action: 'create', calling method: .version_select at 0x7fc9ec287af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1846126148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNitNmaOAgrpluVEszsmtWjy0Xm/YtSXEAS1IeRlNbJnceFcySetZE/q9x5d3mp8axj7WInE43mRY9CPY8NcNv8Kq6ZSDm8MnQfikT4DTfz/8RACPjE8TkxisDrU/rSCeA=="}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:43.096040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-277fdb27-184e-43e6-af65-ffeefd74d4d4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for project 821ce227288a424ea530e4a7c08e41c9. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:16:43.110040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-277fdb27-184e-43e6-af65-ffeefd74d4d4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for user b687d38492594eab876740bdfb7db9ff and project 821ce227288a424ea530e4a7c08e41c9. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:16:43.182753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-277fdb27-184e-43e6-af65-ffeefd74d4d4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.599380 Aug 01 15:16:43.184608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 182/374] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:16:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:16:43.278040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:43.279166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:43.301980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:43.310869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:43.313413 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:43.318861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:43.873609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:43.875233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:43.890342 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:43.891704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:43.893979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:43.894487 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:43.895715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:43.944745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:43.947157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:43.966600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3d80a1a4-c1e3-4706-9fed-a4cea4419da3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.677628 Aug 01 15:16:43.968635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 193/375] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:43 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:44.371779 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:44.387864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-78c3ce42-8c1a-43b1-a70b-e8fbba5d6aaf tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1750 microversion: 2.1 time: 0.523005 Aug 01 15:16:44.401454 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 183/376] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:43 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1750 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:45.021983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:45.032288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:45.064144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.065520 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.066937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.067866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.431794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:45.433187 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:45.445417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.446888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.448814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:45.450039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:45.505061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.539507 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.548879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.552346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b3ca14dd-db12-42c6-b40a-10d1983ecd9f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.546321 Aug 01 15:16:45.553775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 194/377] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:45 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:45.827208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:45.858499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-44c67e01-8d4d-4051-8b8f-895aa1ab2c70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.434321 Aug 01 15:16:45.872849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 184/378] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:45 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:46.598602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:46.604887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:46.622716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.623996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.625707 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.626404 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.898587 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:46.899217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:46.927544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.931239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.934724 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:46.937218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:46.983359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:47.031744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:47.039822 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:47.047541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ec36beb1-74f3-49d0-a8f3-dcf9d22976e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.456833 Aug 01 15:16:47.052797 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 195/379] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:46 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:47.379380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:47.402203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ab1a7396-5f4c-4b7c-be47-e75863c8f0f6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.507740 Aug 01 15:16:47.417196 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 185/380] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:46 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:48.090600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:48.091781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:48.100044 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.100543 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:48.101381 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.101814 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:48.329606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:48.341608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:48.343106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:48.344456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-36a2db67-83f2-4fab-a651-97d511dddc17 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.258235 Aug 01 15:16:48.345091 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 196/381] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:48 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:48.456399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:48.457931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:48.470970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.471765 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:48.473305 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:48.474121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:48.720417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:48.732961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ae829e68-1f55-45d4-a686-86e2e8a014d7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.294363 Aug 01 15:16:48.733568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 186/382] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:48 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:49.391317 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:49.393479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:49.417068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.418366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.420634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.422424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.662134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:49.678516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:49.681938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:49.684298 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-be084519-3268-43af-9e26-ff5c6da94fa1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.304687 Aug 01 15:16:49.685408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 197/383] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:49 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:49.761357 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:49.762550 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:49.775038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.775746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:49.777280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:49.778075 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.055089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.071741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-43f2e483-e03c-4ccd-89d0-b141e245d72f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.316641 Aug 01 15:16:50.072894 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 187/384] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:49 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:50.714370 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:50.714994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:50.722607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.723066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.723854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:50.724300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:50.898779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.914939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.918293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:50.920639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-db926c4a-c83e-4486-b8de-365d68be7a10 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.209933 Aug 01 15:16:50.921645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 198/385] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:50 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:51.115133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:51.116303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:51.126850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.127671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.129749 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.130540 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.411518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:51.429555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e09f8143-7345-4d8b-80d1-138635a2dee4 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.321261 Aug 01 15:16:51.430635 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 188/386] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:51 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:51.958966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:51.959919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:51.970843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.973582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.974751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:51.975685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:51.984825 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=82 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:52.185547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:52.201713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:52.205312 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:52.207945 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e4824b87-9ca8-4002-a6db-c697dfdc5983 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.253562 Aug 01 15:16:52.209093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 199/387] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:51 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:52.461928 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:52.462771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:52.470577 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.471024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.471813 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:52.472277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:52.681763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:52.695508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e5dd2102-ce8d-4509-8ae8-17934a4e2093 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.238089 Aug 01 15:16:52.696403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 189/388] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:52 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:53.141892 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-8e238fac-db6b-426b-9cc6-199f6a2d7a6d req-11559034-8f5a-4410-bc64-8eb2f07f550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "name": "network-vif-plugged", "status": "completed", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:53.159061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8e238fac-db6b-426b-9cc6-199f6a2d7a6d req-11559034-8f5a-4410-bc64-8eb2f07f550c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:53.161212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8e238fac-db6b-426b-9cc6-199f6a2d7a6d req-11559034-8f5a-4410-bc64-8eb2f07f550c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:53.176192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-8e238fac-db6b-426b-9cc6-199f6a2d7a6d req-11559034-8f5a-4410-bc64-8eb2f07f550c service nova] Creating event network-vif-plugged:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:16:53.182792 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-8e238fac-db6b-426b-9cc6-199f6a2d7a6d req-11559034-8f5a-4410-bc64-8eb2f07f550c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045889 Aug 01 15:16:53.183469 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 200/389] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:16:53.243237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:53.244286 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:53.249134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=4 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:53.258529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:53.259176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:53.260300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:53.260961 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:53.265385 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:16:53.456062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:53.466252 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:53.468243 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:53.469574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7f7f2092-c3c7-46da-b387-93aa01620e52 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.233547 Aug 01 15:16:53.470239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 190/390] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:53 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:53.755683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:53.757157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:53.769518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:53.770109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:53.771038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:53.771962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.015254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.025701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-54cec2d3-31a7-4dcb-b8e7-e0742cf24f69 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.290315 Aug 01 15:16:54.026436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 201/391] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:53 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:54.500772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:54.501934 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:54.513643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.514458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.515842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:54.516672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:54.702281 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.713524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.715092 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:54.716331 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-30ec88d9-d95e-4e1b-9c1a-65b87b0dae44 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.223461 Aug 01 15:16:54.716940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 191/392] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:54 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:16:55.051794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:55.052547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:55.060432 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.060912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.062022 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.062436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.314615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.328222 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ee7d2b4d-f2cf-41b5-a2a2-c91cb4687aea tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.280612 Aug 01 15:16:55.328856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 202/393] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:55 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:55.742745 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:55.743671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:55.751499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.752124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.753781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:55.754287 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:55.963805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.981053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.985263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:55.988307 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-23c27a05-2747-4d6a-8747-8ada0a482746 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.249320 Aug 01 15:16:55.989021 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 192/394] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:55 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:56.363891 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:56.364609 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:56.371988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.372437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.373254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:56.373722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:56.614262 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:56.631314 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-147ffbfb-116f-4f9a-b1aa-da7b3be6bc9e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.271268 Aug 01 15:16:56.632285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 203/395] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:56 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:57.017660 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:57.018766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:57.026392 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.027240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.028391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.029172 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.207205 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.217041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.218868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.220206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6c02abe5-c709-4f48-850d-901ed439b27e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.209466 Aug 01 15:16:57.220921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 193/396] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:57 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:57.611445 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:57.612443 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:57.624716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.625514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.626924 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.627713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.670496 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:57.672330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:57.681321 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.681864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.683049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:57.683712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:57.903058 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lazy-loading 'services' on Instance uuid dde1d20a-c1e7-4321-bdd2-a74e52f66489 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:16:57.961278 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:57.974593 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b10335b4-67b6-4c48-bb30-3fe062e47248 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.309799 Aug 01 15:16:57.976175 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 194/397] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:57 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:58.064977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-826e00fc-1f32-4cf1-8699-9787cc33c7b6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments/62401631-0d18-4f6a-b8f9-3f7679a96695" status: 202 len: 0 microversion: 2.1 time: 0.461447 Aug 01 15:16:58.066652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 204/398] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:16:57 2022] DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments/62401631-0d18-4f6a-b8f9-3f7679a96695 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:16:58.245946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:58.246675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:58.254152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.254647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.255903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:58.256453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:58.421842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:58.432516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:58.434061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:58.435264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2cd246d7-f9c9-48b2-885b-13bd5e14e0e3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.193740 Aug 01 15:16:58.435827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 195/399] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:58 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:16:59.012844 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:59.013566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:59.021330 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.021879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.022851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.023296 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.259037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-dc4fb517-4fa9-47b5-9fdc-12d7c73482c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:16:59.273738 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc4fb517-4fa9-47b5-9fdc-12d7c73482c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.275122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc4fb517-4fa9-47b5-9fdc-12d7c73482c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.282665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.297067 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-54d90bc7-256f-4509-9a4b-a2658b21a6e2 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.288656 Aug 01 15:16:59.301663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 205/400] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:59 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:16:59.312666 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-dc4fb517-4fa9-47b5-9fdc-12d7c73482c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Going to try to stop instance {{(pid=117992) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 15:16:59.374020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-dc4fb517-4fa9-47b5-9fdc-12d7c73482c2 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action" status: 202 len: 0 microversion: 2.1 time: 0.123418 Aug 01 15:16:59.375339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 196/401] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:16:59 2022] POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:16:59.387665 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:59.388296 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:59.398362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.398362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.399198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.399852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.467337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:16:59.468702 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:16:59.476766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.477227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.478453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:16:59.478880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:16:59.578105 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.588035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d377d59f-3ecf-4165-a5cd-11f6589e4ad0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.206676 Aug 01 15:16:59.600324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 206/402] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:16:59 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:16:59.639942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.649956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.651524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:16:59.652939 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bcb83188-da71-4863-ae60-8da69445c8bb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.193699 Aug 01 15:16:59.653559 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 197/403] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:16:59 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:00.322769 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:00.324113 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:00.331923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.332363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.333171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.333602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.493699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.502435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4f9aee7-502d-4e40-b8dd-4312a530c029 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.183962 Aug 01 15:17:00.504055 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 207/404] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:00 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:00.613198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:00.614203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:00.620283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.620772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.621581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.622037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.678161 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:00.678882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:00.685194 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.685702 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.686478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:00.686912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:00.804083 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.813394 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6c0d8d8c-6fe2-43a3-a3b9-8f35fb2c5848 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.204582 Aug 01 15:17:00.814067 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 198/405] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:00 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:00.873925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.883266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.884806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:00.886021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fa2328d0-c469-401f-a976-301c20ebac49 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.212567 Aug 01 15:17:00.886597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 208/406] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:00 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:01.535348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:01.536693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:01.549535 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.550324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.551925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.552950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.777358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:01.787117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7f2d909a-fa12-451d-b088-64b6a8f295b7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.261894 Aug 01 15:17:01.792613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 199/407] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:01 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:01.844750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:01.845968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:01.855363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.856328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.857627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.858129 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.886723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:01.889640 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:01.897234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.897818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:01.898687 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:01.899701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:02.060984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.072432 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-38fd1266-1f3b-4577-a9c2-546791f558bc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.235610 Aug 01 15:17:02.074367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 209/408] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:01 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:02.079366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:02.080075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:02.087789 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:02.088327 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:02.089438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:02.089992 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:02.307238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fbc7d226-93b5-4e0e-a0df-8d9ae52f7fb9 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424448 Aug 01 15:17:02.308431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 200/409] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:17:01 2022] POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:02.336782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.355329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.358874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:02.362272 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5af82136-3332-4cad-89ff-d9f1ae3c8859 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.286165 Aug 01 15:17:02.364984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 210/410] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:02 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:02.818634 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:02.819821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:02.832330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:02.833494 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:02.835562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:02.836353 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.061255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.076980 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5df015d0-d77d-4449-b5c4-14bb4dddf7e6 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.266872 Aug 01 15:17:03.079424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 201/411] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:02 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:03.100382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:03.101094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:03.111666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.113220 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.114710 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.115492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.327791 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.338871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c7f869c0-2575-439a-8611-337979841f5b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.242660 Aug 01 15:17:03.339833 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 211/412] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:03 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:03.399561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:03.400234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:03.407531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.407995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.408840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:03.410295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:03.579527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.590926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.592818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:03.594130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-12524b72-9d78-4d4a-bf83-ef2db9231c41 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.200161 Aug 01 15:17:03.594808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 202/413] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:03 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:04.116865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:04.118030 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:04.130910 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.134369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.134369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.134369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.358378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.362632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:04.363242 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:04.367895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f3fbfbe8-9771-4394-bc2e-3a5c4dc5bee7 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.258939 Aug 01 15:17:04.368380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 212/414] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:04 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:04.379285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.379825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.380774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.381446 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.583931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.601610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8bdd6981-3d4d-465f-b027-b3e95981ca24 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.241936 Aug 01 15:17:04.602838 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 203/415] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:04 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:04.620028 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:04.620718 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:04.629989 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.632024 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.634016 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:04.634582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:04.802580 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.812999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.814666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:04.815947 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2ca1e841-e64a-4f3f-840c-ed224853661d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1808 microversion: 2.20 time: 0.200224 Aug 01 15:17:04.816540 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 213/416] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:04 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:05.408623 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.409717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:05.423409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.424168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.425960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.426730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.456194 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:05.637827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.638588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:05.646409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.646876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.647674 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.648117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.667479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:05.678191 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9e40250d-ea66-4a6c-97f1-9ffed9333c3a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1755 microversion: 2.1 time: 0.277207 Aug 01 15:17:05.679016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 204/417] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1755 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:05.843757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:05.844938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:05.855097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.857569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.858958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:05.859747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:05.890629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:05.903125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3049de5d-6446-4cbc-908c-f43e77b8c664 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.268404 Aug 01 15:17:05.903751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 214/418] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:06.064862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:06.083026 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:06.086123 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:06.088032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f5749f48-8851-4e04-b6f5-5c84b5e62449 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1795 microversion: 2.20 time: 0.251272 Aug 01 15:17:06.088750 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 205/419] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:05 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1795 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:06.716988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:06.718006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:06.721078 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=52 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:06.728693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.729306 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.730318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.731200 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.929004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:06.930130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:06.943956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.944855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.946457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:06.947258 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:06.949746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:06.953915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:06.968268 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0a4180e2-70ee-4ee1-8c2d-5e594e8565f1 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1758 microversion: 2.1 time: 0.256191 Aug 01 15:17:06.969355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 215/420] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:06 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1758 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:07.140492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:07.153926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-668f21bd-c181-48f7-b5c9-a4ccb042121b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.231833 Aug 01 15:17:07.154872 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 206/421] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:06 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:08.183435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:08.184278 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:08.193198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.193761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.194662 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:08.195098 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:08.394372 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:08.402721 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e1b318ec-d572-4a08-8aff-b0cf82fc81ec tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.223986 Aug 01 15:17:08.403316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 216/422] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:08 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:09.426377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:09.427304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:09.430473 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:09.436831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.437359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.438292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:09.438782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:09.615834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:09.624049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7883c05a-664b-47dc-beb5-d82c3539c492 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1678 microversion: 2.1 time: 0.203510 Aug 01 15:17:09.624677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 207/423] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:09 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:10.071143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:10.075509 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:10.088710 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.089519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.090925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.091711 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.135944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lazy-loading 'flavor' on Instance uuid 74538684-8b00-48aa-9cff-ca522553b4c3 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:17:10.393427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0767b9b8-c775-4b40-a9dc-d1a6af0a6eed tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/action" status: 200 len: 32 microversion: 2.1 time: 0.330516 Aug 01 15:17:10.394100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 217/424] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:17:10 2022] POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:17:10.405268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:10.406200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:10.415270 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.415705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.416805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.417262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.651518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:10.653011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:10.665468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.666393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.667898 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.668765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.688369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:10.699722 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e2b5c2e2-76b3-438c-b736-1ff874e000c1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.298632 Aug 01 15:17:10.700708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 208/425] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:10.878240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:10.889280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-30289101-1f04-4e2c-beeb-2706d3a3610a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1655 microversion: 2.1 time: 0.246373 Aug 01 15:17:10.889884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 218/426] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:10 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:10.911855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a6d82502-3ef2-4e03-9ebe-0fe487fb4098 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:10.919013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a6d82502-3ef2-4e03-9ebe-0fe487fb4098 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:10.919570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a6d82502-3ef2-4e03-9ebe-0fe487fb4098 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:10.960558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a6d82502-3ef2-4e03-9ebe-0fe487fb4098 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Going to try to start instance {{(pid=117992) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 15:17:11.035024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a6d82502-3ef2-4e03-9ebe-0fe487fb4098 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action" status: 202 len: 0 microversion: 2.1 time: 0.126801 Aug 01 15:17:11.035755 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 209/427] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:17:10 2022] POST /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:17:11.047061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.048148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:11.061983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.063045 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.064541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.065997 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.250788 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:11.260558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dfc4fa7d-7034-47d2-91f4-751207cba4d5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1664 microversion: 2.1 time: 0.219848 Aug 01 15:17:11.261602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 219/428] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1664 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:11.737221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:11.738193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:11.746974 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.747438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.748404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:11.748724 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:11.985637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:11.996918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e8ba197b-6f82-4d32-871f-77085f302d8e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.264849 Aug 01 15:17:11.997893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 210/429] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:11 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:12.284606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:12.285656 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:12.293100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.293550 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.294467 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:12.294945 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:12.450068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:12.459535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c6a5ae38-f280-4b32-a589-849b76473ad8 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1664 microversion: 2.1 time: 0.179887 Aug 01 15:17:12.460139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 220/430] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:12 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:13.037671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:13.038610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:13.046475 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.047010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.047943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.048428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.238403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:13.250131 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-652ced8a-5ada-48b5-b135-6b9d14c49c43 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.218573 Aug 01 15:17:13.250731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 211/431] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:13 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:13.484850 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:13.485683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:13.495473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.495816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.496910 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:13.497282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:13.547177 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2143478712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846126148", "security_groups": [{"name": "tempest-secgroup-smoke-2146828685"}], "block_device_mapping_v2": [{"uuid": "25c9e3c5-7dff-46c0-9ad6-67fe7247ba4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd69fb39-f000-4eff-9ed3-ac19740ad8e8"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:13.685539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:13.697942 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cee20bd8-8332-40d9-a8ac-1b824fd491a9 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1668 microversion: 2.1 time: 0.218120 Aug 01 15:17:13.698993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 221/432] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:13 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1668 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:13.726045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] validate_networks() for [('bd69fb39-f000-4eff-9ed3-ac19740ad8e8', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:17:14.266309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:17:14.266309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:17:14.267384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:17:14.267384 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:17:14.267701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:17:14.277669 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:14.278976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:14.281297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.281801 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.282812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.283478 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.287116 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.289529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.289529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:14.289529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:14.308401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:14.314755 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for user b687d38492594eab876740bdfb7db9ff and project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:14.397949 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:17:14.401826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25c9e3c5-7dff-46c0-9ad6-67fe7247ba4f',volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:17:14.500190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:14.516400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0f2d57cf-37cb-439f-9c39-5e7956ce1920 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.245206 Aug 01 15:17:14.518274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 222/433] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:14 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:14.599878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c3ed204c-29e5-40f8-83ff-ff4a81c9ccb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057123 Aug 01 15:17:14.604655 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 212/434] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:17:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:17:14.618363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-72b8cf8c-0bab-488a-9646-21cffb4dd353 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:14.619160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-72b8cf8c-0bab-488a-9646-21cffb4dd353 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:14.688732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-72b8cf8c-0bab-488a-9646-21cffb4dd353 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:14.701944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-72b8cf8c-0bab-488a-9646-21cffb4dd353 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1095 microversion: 2.1 time: 0.091546 Aug 01 15:17:14.703054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 223/435] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:14 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:15.556313 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:15.557514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:15.570337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.573629 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.575429 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.575899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.737739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:15.739510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:15.750497 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.752408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.753900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:15.754617 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:15.821026 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:15.853008 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e6ff4a2a-7f45-4273-9fd9-afe788234bf1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.300991 Aug 01 15:17:15.869183 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 213/436] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:15 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:15.903352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:15.919206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0cdf95f1-38e6-4364-ba3c-90a999d9f9b8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1193 microversion: 2.1 time: 0.186760 Aug 01 15:17:15.920523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 224/437] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:15 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1193 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:16.896099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:16.897049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:16.908836 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.909591 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:16.910941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.913155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:16.958023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:16.960346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:16.972772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.974107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:16.975716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:16.976502 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:17.140535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:17.150869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1dc5de99-e037-43ff-8112-01e22c5c85f8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1211 microversion: 2.1 time: 0.200319 Aug 01 15:17:17.151468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 225/438] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:16 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:17.419480 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:17.435900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-87345559-e0cd-4d8c-a0f7-dc6274035f24 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.553804 Aug 01 15:17:17.436902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 214/439] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:16 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:18.178821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:18.179783 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:18.187999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.188718 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.190382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.190980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.404265 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:18.418422 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4740e3b9-84da-4c9a-b965-823e3506e198 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.243915 Aug 01 15:17:18.419469 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 226/440] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:18.469028 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:18.469732 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:18.481985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.482781 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.485033 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:18.486099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:18.693348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:18.706732 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cd6a5fea-7a12-49c8-aee9-b754573842eb tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.242769 Aug 01 15:17:18.707782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 215/441] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:18 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:19.456837 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:19.457465 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:19.464772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.465110 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.465890 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.466420 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.646879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:19.655255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-240f807f-cccc-4bc6-8f1a-91855f47333b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.203341 Aug 01 15:17:19.655871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 227/442] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:19 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:19.738207 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:19.738869 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:19.745734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.746165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.747063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:19.747555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:19.913767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:19.926876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ca16d51a-0cb5-439c-ac01-670c7964ae86 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.191787 Aug 01 15:17:19.926876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 216/443] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:19 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:20.680742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:20.681622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:20.694962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.696229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.698064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.699004 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.956373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:20.956987 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:20.958070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:20.966289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.967782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.968231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:20.968777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:20.972885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9e69e058-6ad2-4006-81a7-c6cdfebe032b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.299175 Aug 01 15:17:20.983616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 228/444] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:20 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:21.227414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-30f92242-186c-4f76-abec-83ee21b1c52a req-7476466e-164b-4988-8299-0ccb6932f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0de715-716c-4c4b-8bef-f9be4a2ab216", "tag": "5a318c7f-a2a9-4a98-a77a-46d0604f8ec4"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:21.266955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-30f92242-186c-4f76-abec-83ee21b1c52a req-7476466e-164b-4988-8299-0ccb6932f5ac service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:21.268181 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-30f92242-186c-4f76-abec-83ee21b1c52a req-7476466e-164b-4988-8299-0ccb6932f5ac service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:21.296052 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-30f92242-186c-4f76-abec-83ee21b1c52a req-7476466e-164b-4988-8299-0ccb6932f5ac service nova] Creating event network-changed:5a318c7f-a2a9-4a98-a77a-46d0604f8ec4 for instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 on hv-cinder-80382 Aug 01 15:17:21.308162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-30f92242-186c-4f76-abec-83ee21b1c52a req-7476466e-164b-4988-8299-0ccb6932f5ac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089403 Aug 01 15:17:21.309410 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 229/445] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:17:21.355070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:21.380782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4992d5f0-a390-4341-8829-35c622d11191 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.431374 Aug 01 15:17:21.392321 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 217/446] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:20 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:22.014943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:22.014943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:22.020423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:22.020854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:22.021521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:22.022025 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:22.215328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:22.226097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ba497992-256c-4a5f-b015-a98f170bd66e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.221935 Aug 01 15:17:22.226916 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 230/447] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:22 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:22.416379 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:22.418579 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:22.432730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:22.433219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:22.434224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:22.434695 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:22.844850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:22.857679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7708f081-86d3-4daa-aa15-54eaabfe21a2 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.449026 Aug 01 15:17:22.858380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 218/448] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:22 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:23.254275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:23.255594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:23.268906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:23.269909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:23.271367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:23.272248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:23.510538 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:23.527117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5cec47c4-cc13-4b59-93b6-4a63f9f2494c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.280344 Aug 01 15:17:23.528254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 231/449] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:23 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:23.882688 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:23.883564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:23.891822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:23.892401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:23.893383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:23.893856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:24.137651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:24.154802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-de6fc0f7-be1a-48a4-996c-b4a47b29ef55 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.277421 Aug 01 15:17:24.155918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 219/450] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:23 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:24.556191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:24.557253 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:24.571013 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:24.571841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:24.573569 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:24.574386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:24.584347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:24.696760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:24.841626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:24.856887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dd13ce4a-5f41-4583-80d2-8b9300f5baff tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.308512 Aug 01 15:17:24.857998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 232/451] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:24 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:25.194377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:25.195421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:25.199327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:25.200593 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:25.213215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.214073 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:25.215519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.216324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:25.444811 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:25.449230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:25.464287 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e8dcfef9-22c5-4389-87e0-6db8fc27eb2e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.278441 Aug 01 15:17:25.465601 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 220/452] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:25 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:25.891661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:25.892901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:25.902360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.902709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:25.903503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:25.903959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:26.113120 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:26.123144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c58af84e-edfa-4270-895f-6cac64214729 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.236315 Aug 01 15:17:26.123744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 233/453] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:25 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:26.504882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:26.505610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:26.514486 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:26.515100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:26.516047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:26.516729 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:26.755037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:26.765899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1f165967-7f4a-45c2-9936-05bcacf55d12 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.266052 Aug 01 15:17:26.766677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 221/454] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:26 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:27.148649 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:27.149993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:27.162728 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.163510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.165039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.165827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.350773 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:27.359391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-08f263ff-8110-4c3b-ad70-86d4b232bcb2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.218663 Aug 01 15:17:27.359987 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 234/455] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:27 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:27.800426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:27.801477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:27.813264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.813874 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.815376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:27.816188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:27.971712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:27.988178 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-623afd00-25de-49de-a8e5-7bd7f5b97222 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.195338 Aug 01 15:17:27.989269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 222/456] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:27 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:28.387935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:28.388827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:28.395804 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:28.396300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:28.397288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:28.397705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:28.570514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:28.579265 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-905d3a98-6d5c-4fad-8aa0-317b34781dab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.195200 Aug 01 15:17:28.579865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 235/457] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:28 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:29.011748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:29.012452 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:29.019453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:29.019780 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:29.020599 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:29.021040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:29.163211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:29.172087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-75bbb55d-bf59-45d7-b194-a7ba88733a79 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.164335 Aug 01 15:17:29.172709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 223/458] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:29 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:29.601310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:29.601947 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:29.609179 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:29.609631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:29.610403 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:29.610841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:29.759358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:29.767672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2b32ccca-fbe9-433f-8cd3-05b78459fe7f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.170131 Aug 01 15:17:29.768764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 236/459] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:29 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:30.195670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:30.196281 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:30.203041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.203497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.204302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.204779 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.355243 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:30.364437 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fc2f41b7-6de5-4119-a824-787bd4827c25 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.173025 Aug 01 15:17:30.365042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 224/460] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:30 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:30.789698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:30.790254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:30.797225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.797666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.798541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:30.799517 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:30.948521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:30.956905 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-34bca24f-c7bb-4114-9725-9ec2b84ba5fa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.170907 Aug 01 15:17:30.957328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 237/461] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:30 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:31.387423 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:31.388042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:31.395375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.395833 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:31.396654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.397097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:31.537979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:31.547425 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a31516a1-6e23-4d1f-b614-054dfef867a8 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.163465 Aug 01 15:17:31.548024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 225/462] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:31 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:31.978559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:31.979198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:31.985977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.986968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:31.987740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:31.988176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:32.131553 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:32.139688 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7dbad609-be16-4af8-925d-2dec8284d1c0 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.164885 Aug 01 15:17:32.140276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 238/463] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:31 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:32.569901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:32.570517 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:32.576694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:32.577149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:32.577922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:32.578357 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:32.717324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:32.726266 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-06d0ffc3-859f-49eb-a785-9d9356e18c0e tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.160526 Aug 01 15:17:32.726841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 226/464] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:32 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:33.160152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:33.160787 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:33.167437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.167938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.168747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.169193 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.299862 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:33.307556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5d79c66a-3e76-4852-b602-79bfb394a90f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.151369 Aug 01 15:17:33.308158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 239/465] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:33 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:33.748445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:33.749084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:33.755766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.756221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.757037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:33.757476 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:33.894966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:33.902946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e7dba7eb-8f24-421b-9fe2-12336b277683 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.158349 Aug 01 15:17:33.903518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 227/466] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:33 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:34.328234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:34.328853 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:34.336089 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.336585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:34.337356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.337794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:34.477604 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:34.485341 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e6b35071-109d-4672-b845-77e7ef13b811 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.160944 Aug 01 15:17:34.485894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 240/467] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:34 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:34.924861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:34.925591 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:34.932399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.932884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:34.933698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:34.934141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:35.065653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:35.073851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-de3e99ce-116b-4406-84aa-1c1088a384b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.152807 Aug 01 15:17:35.074427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 228/468] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:34 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:35.506416 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:35.507834 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:35.514602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:35.515051 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:35.515819 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:35.516256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:35.651985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:35.659695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bf5a622b-0d3a-4a2d-90f9-09df05120280 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.157621 Aug 01 15:17:35.660266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 241/469] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:35 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:36.095327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:36.096447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:36.103146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:36.103601 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.104375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:36.104846 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.245670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:36.253697 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-44891256-56c3-4984-a1a4-eb323a6eb224 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1734 microversion: 2.1 time: 0.162287 Aug 01 15:17:36.254268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 229/470] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:36 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:36.680515 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:36.681191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:36.687765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:36.688299 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.689059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:36.689490 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:36.824645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:36.832693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0b778ab0-7750-41f9-8e5b-70afaf22e407 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.155934 Aug 01 15:17:36.833267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 242/471] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:36 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:37.250032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-6abd8c0f-e855-4001-903a-59e4366290e9 req-1e45c81c-870f-45b6-8b39-c7bd9511b355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0de715-716c-4c4b-8bef-f9be4a2ab216", "name": "network-vif-plugged", "status": "completed", "tag": "5a318c7f-a2a9-4a98-a77a-46d0604f8ec4"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:37.266055 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-6abd8c0f-e855-4001-903a-59e4366290e9 req-1e45c81c-870f-45b6-8b39-c7bd9511b355 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.266574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-6abd8c0f-e855-4001-903a-59e4366290e9 req-1e45c81c-870f-45b6-8b39-c7bd9511b355 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.279145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:37.280223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:37.286759 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=58 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:37.291608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-6abd8c0f-e855-4001-903a-59e4366290e9 req-1e45c81c-870f-45b6-8b39-c7bd9511b355 service nova] Creating event network-vif-plugged:5a318c7f-a2a9-4a98-a77a-46d0604f8ec4 for instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 on hv-cinder-80382 Aug 01 15:17:37.297042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-6abd8c0f-e855-4001-903a-59e4366290e9 req-1e45c81c-870f-45b6-8b39-c7bd9511b355 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050614 Aug 01 15:17:37.297633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 230/472] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:37.298807 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.299602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.300984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.301779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.839094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:37.847236 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-838bfe3a-df51-4264-b092-2f6abf5d9553 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1714 microversion: 2.1 time: 0.575340 Aug 01 15:17:37.847862 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 243/473] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:37 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1714 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:37.855094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:37.856078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:37.863230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.863685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.864496 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.864938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.961097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:37.961589 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:37.967587 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.968032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:37.968825 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:37.969262 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.009285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:38.018675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-953be173-b415-4333-b0c5-aee235d1bf73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.167721 Aug 01 15:17:38.019250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 231/474] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:37 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:38.055001 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] HTTP exception thrown: Cannot 'detach_volume' instance 74538684-8b00-48aa-9cff-ca522553b4c3 while it is in vm_state rescued Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Request method failure captured: Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments/cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3 HTTP/1.1 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-1-2vSqWBuWhaSq4AEzY4TXCnlOWyl3WITgcy8evJh2I_YwHwPgR3Wxm-f1JkEfRxcUTIwey0kbWMQrQSpWv3xau-Zy5Bn33Sc5FSDvrkKFx-uYqa3MmdrXseXKXeR6ySD-_KFOw1PV0Rx1hAbBqhbhdlMjPw9BQAhUZQ-ljrAbc20 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:17:38.056652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_29b33a1fb52146918d3c0bd0d23d2dfa", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3af3a5c1c2f94e51bee936b4762dc14c Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:17:38.058243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Cannot 'detach_volume' instance 74538684-8b00-48aa-9cff-ca522553b4c3 while it is in vm_state rescued Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'server_id': '74538684-8b00-48aa-9cff-ca522553b4c3', 'id': 'cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3'} Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:38.059160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 74538684-8b00-48aa-9cff-ca522553b4c3 while it is in vm_state rescued Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 74538684-8b00-48aa-9cff-ca522553b4c3 while it is in vm_state rescued Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:38.060746 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Returning 409 to user: Cannot 'detach_volume' instance 74538684-8b00-48aa-9cff-ca522553b4c3 while it is in vm_state rescued {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:38.062066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-453de868-fd42-43b9-96ce-801181a4f8c0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments/cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3" status: 409 len: 152 microversion: 2.1 time: 0.100921 Aug 01 15:17:38.062066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 244/475] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:17:37 2022] DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments/cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 15:17:38.067038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:38.067561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:38.073505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.073951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.074831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.075272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.148788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9ed5e9a1-7029-4002-87dc-eb517497a5b3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/action" status: 202 len: 0 microversion: 2.1 time: 0.085280 Aug 01 15:17:38.152859 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 232/476] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:17:38 2022] POST /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:17:38.158619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:38.159291 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:38.165532 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.165984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.166752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:38.167199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:38.304958 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:38.313684 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1d7c8a89-ae72-4d24-91ff-910e9aa99da0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1722 microversion: 2.1 time: 0.159378 Aug 01 15:17:38.314314 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 245/477] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:38 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:39.040507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:39.041211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:39.047604 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.048061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.048869 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.049310 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.187628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:39.196207 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2ef1db0f-1e80-42c7-bc17-ac64d2d695ab tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1267 microversion: 2.1 time: 0.160460 Aug 01 15:17:39.196810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 233/478] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:39 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:39.336237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:39.336978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:39.343541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.344007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.344846 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:39.345289 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:39.503775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:39.513919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ed977e17-290e-4817-bcc8-650c31222629 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1722 microversion: 2.1 time: 0.181554 Aug 01 15:17:39.514506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 246/479] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:39 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:40.216833 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:40.217680 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:40.220083 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:40.226216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.226673 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.227450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.227900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.374387 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:40.382262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c8105ddf-0e07-4893-952e-3c2fabe0b75b tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1453 microversion: 2.1 time: 0.169626 Aug 01 15:17:40.382871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 234/480] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:40 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:40.402368 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:40.402976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:40.410156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.410603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.411365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.411790 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.535854 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:40.536482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:40.543442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:40.544005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.544475 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.545262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:40.545702 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:40.552249 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf97eabd-4310-4bbe-8c5f-a8ca940de15a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1453 microversion: 2.1 time: 0.153560 Aug 01 15:17:40.552849 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 247/481] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:40 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:40.704610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:40.714954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e68dc401-26d7-4a43-a502-5900990f891d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1722 microversion: 2.1 time: 0.183509 Aug 01 15:17:40.715556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 235/482] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:40 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:17:41.737893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:41.738496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:41.745321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:41.745761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:41.746610 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:41.746957 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:41.895530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:41.897857 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:41.905527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8f5703ab-fdef-484d-a7f8-e3d4152d8ec0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1722 microversion: 2.1 time: 0.171866 Aug 01 15:17:41.906122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 248/483] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:41 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:42.651103 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-e7dd35bb-63a6-479a-8c0d-aba62f2bea86 req-d62353dc-6bae-4a3b-95e6-20ac1c622d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0de715-716c-4c4b-8bef-f9be4a2ab216", "tag": "5a318c7f-a2a9-4a98-a77a-46d0604f8ec4"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:42.661121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e7dd35bb-63a6-479a-8c0d-aba62f2bea86 req-d62353dc-6bae-4a3b-95e6-20ac1c622d66 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.661617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e7dd35bb-63a6-479a-8c0d-aba62f2bea86 req-d62353dc-6bae-4a3b-95e6-20ac1c622d66 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.672915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-e7dd35bb-63a6-479a-8c0d-aba62f2bea86 req-d62353dc-6bae-4a3b-95e6-20ac1c622d66 service nova] Creating event network-changed:5a318c7f-a2a9-4a98-a77a-46d0604f8ec4 for instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 on hv-cinder-80382 Aug 01 15:17:42.677701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-e7dd35bb-63a6-479a-8c0d-aba62f2bea86 req-d62353dc-6bae-4a3b-95e6-20ac1c622d66 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030396 Aug 01 15:17:42.678292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 236/484] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:42.928889 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:42.929652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:42.936769 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.937522 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:42.938301 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:42.938909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.106491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:43.115752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6d248874-5736-4a67-bd87-b00da4e229f0 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1728 microversion: 2.1 time: 0.191150 Aug 01 15:17:43.116679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 249/485] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:42 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1728 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:43.139693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:43.140633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:43.147818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.148796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.149804 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:43.150259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:43.330566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f197b2de-08f8-4cea-89b8-bb04faed92f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194886 Aug 01 15:17:43.331173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 237/486] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:17:43 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:17:44.692395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}, {"name": "network-changed", "server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:44.702727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:44.703171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:44.717644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] Creating event network-changed:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:17:44.718154 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] Creating event network-changed:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:17:44.724263 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6ddafec4-9182-4bac-80f8-9f79d8a572d4 req-ead3f959-f2b6-4271-a9e5-276188b91900 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035572 Aug 01 15:17:44.725176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 250/487] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:48.567141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:48.567763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:48.575942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.576433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.577200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.577632 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.581016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:17:48.611946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-51d17281-48b3-4502-b071-09124d364b95 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments/ca9d8117-f82f-4fee-855f-658bb9f89441" status: 200 len: 194 microversion: 2.20 time: 0.052329 Aug 01 15:17:48.612564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 238/488] 10.222.0.93 () {60 vars in 1454 bytes} [Mon Aug 1 15:17:48 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments/ca9d8117-f82f-4fee-855f-658bb9f89441 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:48.698620 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:48.699247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:48.706544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.706979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.707759 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.708192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.804248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lazy-loading 'services' on Instance uuid f38a15b5-6333-48d9-89cc-fd29dd223d7e {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:17:48.893819 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3f695dc0-9875-4066-a417-c3d0145cc61e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments/ca9d8117-f82f-4fee-855f-658bb9f89441" status: 202 len: 0 microversion: 2.20 time: 0.201119 Aug 01 15:17:48.894593 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 251/489] 10.222.0.93 () {60 vars in 1457 bytes} [Mon Aug 1 15:17:48 2022] DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments/ca9d8117-f82f-4fee-855f-658bb9f89441 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:17:48.903367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:48.905613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:48.912117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.912600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.913389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:48.913885 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:48.949419 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3b418f2c-f4be-4b44-8c1d-199ffc490cc9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050078 Aug 01 15:17:48.949998 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 239/490] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Aug 1 15:17:48 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:17:49.963202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:49.965477 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:49.971735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.972182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:49.972991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:49.973409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.003150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-90b91d20-d800-46f1-ab62-7184aa32ae01 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044763 Aug 01 15:17:50.003707 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 252/491] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Aug 1 15:17:49 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:50.065421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:50.065935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:50.072449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.072938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.073705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.074149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.099626 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:17:50.175348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4ef05366-83e0-4316-acd9-e6a72f1ea2fd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 204 len: 0 microversion: 2.20 time: 0.113528 Aug 01 15:17:50.175936 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 240/492] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Aug 1 15:17:50 2022] DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:17:50.184807 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:50.185415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:50.191696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.192145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.193021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:50.193383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:50.325486 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:50.333778 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:50.335267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:50.336407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7b1882f4-a0a8-4e2a-bacf-94ef108707db tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.155713 Aug 01 15:17:50.336989 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 253/493] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:50 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:51.361268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:51.361953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:51.368451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.368921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:51.369684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:51.370114 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:51.504198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:51.512602 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:51.514091 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:51.515258 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0ceb3fee-26fc-4fbb-bd4e-35381f73a200 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.158808 Aug 01 15:17:51.515809 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 241/494] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:51 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:52.539529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:52.540228 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:52.547233 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:52.547717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:52.548849 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:52.549356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:52.691286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:52.702128 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:52.703789 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:52.705843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b3531a5f-9697-4952-a183-8d5bc571c468 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 200 len: 1723 microversion: 2.20 time: 0.170197 Aug 01 15:17:52.706719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 254/495] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:52 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:52.975991 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-e8a657dd-a598-42ed-a451-a3e78d5d52eb req-92ae6f85-6f19-4312-ac9a-eda410f2d409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38a15b5-6333-48d9-89cc-fd29dd223d7e", "name": "network-vif-deleted", "tag": "5dd991aa-fdb5-4f08-b824-e21e72b9f6cb"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:52.993939 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e8a657dd-a598-42ed-a451-a3e78d5d52eb req-92ae6f85-6f19-4312-ac9a-eda410f2d409 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:52.994784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e8a657dd-a598-42ed-a451-a3e78d5d52eb req-92ae6f85-6f19-4312-ac9a-eda410f2d409 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.009592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-e8a657dd-a598-42ed-a451-a3e78d5d52eb req-92ae6f85-6f19-4312-ac9a-eda410f2d409 service nova] Creating event network-vif-deleted:5dd991aa-fdb5-4f08-b824-e21e72b9f6cb for instance f38a15b5-6333-48d9-89cc-fd29dd223d7e on hv-cinder-80382 Aug 01 15:17:53.015366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-e8a657dd-a598-42ed-a451-a3e78d5d52eb req-92ae6f85-6f19-4312-ac9a-eda410f2d409 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044670 Aug 01 15:17:53.016913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 242/496] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:17:53.732736 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:53.733352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:53.741112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.741564 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.742480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:53.742928 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:53.758561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e HTTP/1.1 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:17:53.760939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:17:53.762581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'f38a15b5-6333-48d9-89cc-fd29dd223d7e'} Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:17:53.763354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:17:53.764558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:17:53.765660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:17:53.765660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fcde2e10-1393-4832-947f-453bbe0381a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 404 len: 111 microversion: 2.20 time: 0.036319 Aug 01 15:17:53.765660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 255/497] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:53 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:17:53.772706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-55a1dca8-97cf-409c-9040-d2db9cacf5cf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '.version_select at 0x7fc9ec1891f0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:53.796857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-55a1dca8-97cf-409c-9040-d2db9cacf5cf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-406286181" status: 204 len: 0 microversion: 2.20 time: 0.028650 Aug 01 15:17:53.797434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 243/498] 10.222.0.93 () {60 vars in 1259 bytes} [Mon Aug 1 15:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-406286181 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:17:54.522405 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cfdc7daf-8dbe-4346-8795-21f31b1262f9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: .version_select at 0x7fc9ec7afdc0>, body: {"keypair": {"name": "tempest-keypair-323573505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS2h+iKGheYfRuGobWIGQwfFqBL2Rmkdsxyg8EwmtXah+RTNEixOY1ZbhoTRANPEEQfQansGQFEy6p6+P8lus9aNR0bYkzpVY1wKJsjwqCB22fBM9JooI24EeNKuiF1fA=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:54.539072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-cfdc7daf-8dbe-4346-8795-21f31b1262f9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for project 8b18759847b44a698a092e4484b244d0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:54.542964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-cfdc7daf-8dbe-4346-8795-21f31b1262f9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for user 3c18437883ce42369c7563224c208523 and project 8b18759847b44a698a092e4484b244d0. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:54.567592 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cfdc7daf-8dbe-4346-8795-21f31b1262f9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049057 Aug 01 15:17:54.568189 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 256/499] 10.222.0.93 () {62 vars in 1200 bytes} [Mon Aug 1 15:17:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 15:17:55.953558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-676605138", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03f2f7b6-6696-4300-b786-a55a2c829f71"}], "security_groups": [{"name": "tempest-securitygroup--275946930"}], "key_name": "tempest-keypair-323573505", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:17:56.061790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] validate_networks() for [('03f2f7b6-6696-4300-b786-a55a2c829f71', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:17:56.444806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:17:56.445227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:17:56.445697 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:17:56.446102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:17:56.446558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:17:56.455636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.456078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.456907 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:56.457334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:56.474056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for project 8b18759847b44a698a092e4484b244d0. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:17:56.477945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Getting quotas for user 3c18437883ce42369c7563224c208523 and project 8b18759847b44a698a092e4484b244d0. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:17:56.489652 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:17:56.492043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:17:56.538783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3eb1fe38-15a5-4073-9494-362f524bc756 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.590166 Aug 01 15:17:56.539674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 244/500] 10.222.0.93 () {62 vars in 1188 bytes} [Mon Aug 1 15:17:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 15:17:56.550818 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:56.551674 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:56.617409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:56.630855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:56.633715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:56.635071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-18071d62-0344-4aff-a270-235c03ff3e4c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1280 microversion: 2.20 time: 0.088603 Aug 01 15:17:56.636160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 257/501] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:56 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:57.010398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.012652 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.019039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.019495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.020275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.020738 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.053622 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-10f01f78-5671-4c31-be9d-6a1b2fdc64ae tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047534 Aug 01 15:17:57.054193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 245/502] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:17:57 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:17:57.116063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.116585 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.122768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.123239 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.124240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.124782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.151491 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:17:57.238652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7fb18c88-6980-446d-8934-86d6ce64f862 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 204 len: 0 microversion: 2.1 time: 0.126103 Aug 01 15:17:57.239361 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 258/503] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:17:57 2022] DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:17:57.247477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.248169 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.254095 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.254535 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.255334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.255720 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.385737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:57.393684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1d13ca19-7ed8-40a4-adc4-965e47cad781 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1674 microversion: 2.1 time: 0.149995 Aug 01 15:17:57.394249 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 246/504] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:57 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:57.661908 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:57.662509 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:57.669183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.669627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.670391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:57.670828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:57.738384 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:57.746883 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:57.748380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:57.749722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a20de887-9aab-4e61-b29c-c789646e9572 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1340 microversion: 2.20 time: 0.092200 Aug 01 15:17:57.750284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 259/505] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:57 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:17:58.414628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:58.415230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:58.421819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.422261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.423717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.424154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.565269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.572859 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-71309c3e-bbce-4abb-a1f3-071ddd7be07e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1674 microversion: 2.1 time: 0.161998 Aug 01 15:17:58.573424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 247/506] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:58 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:58.774151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:58.774703 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:58.781961 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.782957 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.783733 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:58.784160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:58.849976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.858259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.859777 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:58.860956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf85e56c-4661-4e20-af7c-3ac32f9f567a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1340 microversion: 2.20 time: 0.091064 Aug 01 15:17:58.861514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 260/507] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:58 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:17:59.593723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:59.594330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:59.600926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.601439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.602142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.602584 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.784223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:59.794795 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-69af41da-26dd-4062-9ce1-7ada2d83ae9e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1674 microversion: 2.1 time: 0.204760 Aug 01 15:17:59.795398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 248/508] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:17:59 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:17:59.883455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:17:59.884065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:17:59.891006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.891458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.892254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:17:59.892716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:17:59.958564 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:59.966853 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:59.968399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:17:59.970250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bae2d054-038f-49c9-b303-65a04ad68b24 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1338 microversion: 2.20 time: 0.090251 Aug 01 15:17:59.971087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 261/509] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:17:59 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:00.817887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:00.821264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:00.829435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.830626 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.831366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:00.831820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:00.961450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:00.969575 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1c9922d2-358f-44dd-b77a-cd540c1a4d4b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1606 microversion: 2.1 time: 0.155982 Aug 01 15:18:00.970158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 249/510] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:00 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1606 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:00.994933 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:00.995654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:01.003343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.003826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.018629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.019168 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.180922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.195195 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.196766 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:01.198621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-df25a4fc-df0a-47db-8117-830d76cd670e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.206905 Aug 01 15:18:01.198621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 262/511] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:00 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:01.634941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-664974b2-ca2e-4a45-a731-b310ef8877f5 req-6b10bedd-31ce-4699-ab14-f42bdd8563c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde1d20a-c1e7-4321-bdd2-a74e52f66489", "name": "network-vif-deleted", "tag": "9023cf59-8289-4e54-ac4f-4cb12c410d41"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:01.646696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-664974b2-ca2e-4a45-a731-b310ef8877f5 req-6b10bedd-31ce-4699-ab14-f42bdd8563c8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:01.646936 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-664974b2-ca2e-4a45-a731-b310ef8877f5 req-6b10bedd-31ce-4699-ab14-f42bdd8563c8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:01.659283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-664974b2-ca2e-4a45-a731-b310ef8877f5 req-6b10bedd-31ce-4699-ab14-f42bdd8563c8 service nova] Creating event network-vif-deleted:9023cf59-8289-4e54-ac4f-4cb12c410d41 for instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 on hv-cinder-80382 Aug 01 15:18:01.665300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-664974b2-ca2e-4a45-a731-b310ef8877f5 req-6b10bedd-31ce-4699-ab14-f42bdd8563c8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034969 Aug 01 15:18:01.666234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 250/512] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:01.991192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:01.992522 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:01.999100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.000066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.000688 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.001749 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.041140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.041726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.042262 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lazy-loading 'fault' on Instance uuid dde1d20a-c1e7-4321-bdd2-a74e52f66489 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:02.090674 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.099637 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-de3eba3c-3563-44b4-86ae-6954971dbeca tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 200 len: 1326 microversion: 2.1 time: 0.112116 Aug 01 15:18:02.105266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 263/513] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:01 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:02.300372 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:02.301105 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:02.308887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.309118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.310557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:02.312563 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:02.542234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.553257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.555583 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:02.557274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-27f3fafd-cae6-4f33-adf6-6301e54a4e33 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.339198 Aug 01 15:18:02.558163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 251/514] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:02 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:18:03.121724 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.122358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:03.130619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.131083 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.132003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.132453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.149216 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 HTTP/1.1 Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:18:03.150923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:18:03.152623 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'dde1d20a-c1e7-4321-bdd2-a74e52f66489'} Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:03.153614 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:18:03.155145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:03.156594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:03.156594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3f495ffc-8766-4207-96f9-2ef3b43146fc tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 404 len: 111 microversion: 2.1 time: 0.034662 Aug 01 15:18:03.156594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 264/515] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:03 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:18:03.161851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-31b3280b-9ab9-4d79-8115-de3623fbce83 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '.version_select at 0x7fc9ec189280>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.186847 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-31b3280b-9ab9-4d79-8115-de3623fbce83 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59681120" status: 202 len: 0 microversion: 2.1 time: 0.028865 Aug 01 15:18:03.187461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 252/516] 10.222.0.93 () {58 vars in 1215 bytes} [Mon Aug 1 15:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59681120 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:03.591483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:03.592621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:03.604309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.605397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.606764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.607541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.690437 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-62a975c5-e2fd-4ff5-a47f-7c7dad251ce4 req-0fc3a2c1-1d5d-499b-be15-f5a4d05f473d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:03.711349 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-62a975c5-e2fd-4ff5-a47f-7c7dad251ce4 req-0fc3a2c1-1d5d-499b-be15-f5a4d05f473d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:03.712074 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-62a975c5-e2fd-4ff5-a47f-7c7dad251ce4 req-0fc3a2c1-1d5d-499b-be15-f5a4d05f473d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:03.737283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-62a975c5-e2fd-4ff5-a47f-7c7dad251ce4 req-0fc3a2c1-1d5d-499b-be15-f5a4d05f473d service nova] Creating event network-changed:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:18:03.746101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-62a975c5-e2fd-4ff5-a47f-7c7dad251ce4 req-0fc3a2c1-1d5d-499b-be15-f5a4d05f473d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060674 Aug 01 15:18:03.747040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 253/517] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:03.786567 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:03.799867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:03.802021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:03.803272 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4f1c5859-7f5a-4c41-bf12-ff351ecdf772 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.219019 Aug 01 15:18:03.803782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 265/518] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:03 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:04.110039 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-51c28738-7b0d-433b-a457-2620fdcc87e7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: .version_select at 0x7fc9ec19cf70>, body: {"keypair": {"name": "tempest-keypair-301399490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ0Dw2daLu8Yi/wLKF6M3mjPcbfGoL+1MsLNVv4qmeR8q7EZB6xs9MBUNIDEd4/Ub0f6Z/3ZtZgY2+ZeBlSnlLzKS9/x1EKOKeChCWm70jxgqIMgQDevVdKkiHoXTrNnQ=="}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:04.138247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-51c28738-7b0d-433b-a457-2620fdcc87e7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for project 916870664da8419eb5466fd75b15987d. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:18:04.144341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-51c28738-7b0d-433b-a457-2620fdcc87e7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for user 5a49850f6d8a474d83821f5f49dff06c and project 916870664da8419eb5466fd75b15987d. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:18:04.174221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-51c28738-7b0d-433b-a457-2620fdcc87e7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070377 Aug 01 15:18:04.175082 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 254/519] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:18:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:04.827512 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:04.828184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:04.836115 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.836643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:04.837525 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:04.837848 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:05.000172 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:05.002607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:05.011033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:05.012851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:05.013996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-238f74b6-1be1-4ded-8722-138bac6fb88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.190645 Aug 01 15:18:05.014556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 266/520] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:04 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:05.787276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-209736393", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11e15496-1f56-46e5-b6a2-dabb8c5f6af3"}], "security_groups": [{"name": "tempest-securitygroup--2137148914"}], "key_name": "tempest-keypair-301399490", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:05.900839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] validate_networks() for [('11e15496-1f56-46e5-b6a2-dabb8c5f6af3', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:18:06.036930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:06.037679 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:06.046024 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.046515 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.047421 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.048307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.213280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:06.222264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:06.223808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:06.224988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-25b44cae-7bb6-4fdb-bfc8-50036b54da1e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.191936 Aug 01 15:18:06.225560 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 267/521] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:06 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:18:06.304016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:18:06.304440 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:18:06.304955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:18:06.305360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:18:06.305776 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:18:06.314887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.315330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.316147 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:06.316613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:06.334139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for project 916870664da8419eb5466fd75b15987d. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:18:06.338188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Getting quotas for user 5a49850f6d8a474d83821f5f49dff06c and project 916870664da8419eb5466fd75b15987d. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:18:06.349899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:18:06.352267 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:18:06.398126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fa609625-415e-4aa7-8a3c-72f57147073f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.615268 Aug 01 15:18:06.398958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 255/522] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:18:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:18:06.410256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5d0da7b6-7980-476f-bd6f-d1f2933633c6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:06.410893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5d0da7b6-7980-476f-bd6f-d1f2933633c6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:06.463328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5d0da7b6-7980-476f-bd6f-d1f2933633c6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:06.470839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5d0da7b6-7980-476f-bd6f-d1f2933633c6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1236 microversion: 2.1 time: 0.065074 Aug 01 15:18:06.471408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 268/523] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:06 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:07.251891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:07.253261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:07.264812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.265633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.267612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.268336 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.406647 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-fd2ef10c-3510-469a-991c-e74635fdca75 req-0ca949e4-a794-43d7-9404-0373363305d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "name": "network-vif-plugged", "status": "completed", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:07.420814 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:07.423874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fd2ef10c-3510-469a-991c-e74635fdca75 req-0ca949e4-a794-43d7-9404-0373363305d8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.424575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-fd2ef10c-3510-469a-991c-e74635fdca75 req-0ca949e4-a794-43d7-9404-0373363305d8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.437682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-fd2ef10c-3510-469a-991c-e74635fdca75 req-0ca949e4-a794-43d7-9404-0373363305d8 service nova] Creating event network-vif-plugged:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:18:07.450223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-fd2ef10c-3510-469a-991c-e74635fdca75 req-0ca949e4-a794-43d7-9404-0373363305d8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046906 Aug 01 15:18:07.452676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 269/524] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:07.499258 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:07.500205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:07.511796 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.512511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.513343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:07.513828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:07.522273 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.533620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.537223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.539675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a23cbe24-f353-4f85-9f80-55429f0d02e7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.295048 Aug 01 15:18:07.545387 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 256/525] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:07 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:07.622594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:07.632241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-79d9185d-5aa3-497d-9b86-dc328f5cfc1b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1296 microversion: 2.1 time: 0.144014 Aug 01 15:18:07.632878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 270/526] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:07 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1296 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:08.571556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:08.572378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:08.583716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.584532 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.585908 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.586704 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.653784 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:08.654418 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:08.664984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.665734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.667184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:08.668008 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:08.744681 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.753197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.754835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.756221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e0317315-874a-4cc0-9aed-d23278a94d25 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1405 microversion: 2.20 time: 0.190630 Aug 01 15:18:08.756819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 257/527] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:08 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:08.834010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:08.849324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c512efa3-cc28-46b3-860e-7b2256ae81f1 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.199315 Aug 01 15:18:08.850023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 271/528] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:08 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:09.413693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-857fe681-f4fb-41b1-a26a-a45b82cd7e66 req-b729666b-cb02-4a5a-8066-e0bd12d5dcdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4919bd3e-4151-4ecf-ae29-6bc5c3086e90", "tag": "6badacde-1e04-4d6e-b3ca-915f3ab74e5a"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:09.419111 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:09.427942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-857fe681-f4fb-41b1-a26a-a45b82cd7e66 req-b729666b-cb02-4a5a-8066-e0bd12d5dcdb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.431010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-857fe681-f4fb-41b1-a26a-a45b82cd7e66 req-b729666b-cb02-4a5a-8066-e0bd12d5dcdb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.449382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-857fe681-f4fb-41b1-a26a-a45b82cd7e66 req-b729666b-cb02-4a5a-8066-e0bd12d5dcdb service nova] Creating event network-changed:6badacde-1e04-4d6e-b3ca-915f3ab74e5a for instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 on hv-cinder-80382 Aug 01 15:18:09.455045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-857fe681-f4fb-41b1-a26a-a45b82cd7e66 req-b729666b-cb02-4a5a-8066-e0bd12d5dcdb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045072 Aug 01 15:18:09.455991 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 258/529] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:09.782764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:09.783380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:09.799322 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.800134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.801641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.802338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.875116 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:09.877602 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:09.885830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.886863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.888123 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:09.888445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:09.976363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:09.986743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:09.988281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:09.989535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-02c1a197-7067-42bc-96f6-4284673a6feb tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1597 microversion: 2.20 time: 0.211278 Aug 01 15:18:09.990101 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 272/530] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:09 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1597 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:10.013506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:10.014023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:10.024852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.025321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.026114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.026559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.119734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7b8a6fe5-d94b-42f0-8776-cd9edf53c747 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111038 Aug 01 15:18:10.120764 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 273/531] 10.222.0.93 () {60 vars in 1316 bytes} [Mon Aug 1 15:18:10 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 15:18:10.124888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:10.133891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7697cfd2-a20a-425e-9ba9-a1ece2de9bcb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.264953 Aug 01 15:18:10.134686 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 259/532] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:09 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:10.445236 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-502218870"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:10.446235 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:10.458360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.459158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.460626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:10.461412 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:10.720976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.network.security_group_api [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Removing security group cc6a7fdc-1e94-4243-9e0e-c3bcda0ee6c8 from port 87b90173-3201-499e-b0ba-c81666855480 Aug 01 15:18:11.157949 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:11.158566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:11.165592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:11.166044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:11.166981 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:11.167260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:11.170375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:11.456908 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:11.472159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-eb29eb2f-c4ea-40c8-9623-fb23c4019c34 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.320232 Aug 01 15:18:11.473260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 260/533] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:11 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:11.609906 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8640bf50-2d3a-48c7-8844-1998c8430c2d tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action" status: 202 len: 0 microversion: 2.1 time: 1.171795 Aug 01 15:18:11.614004 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 274/534] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:18:10 2022] POST /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/action => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:11.632420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-9e6e2409-f028-40bf-ab58-6b5bcfe354ed req-747b42d5-94fa-41d4-a1ec-1d8b426b1600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:11.654784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-9e6e2409-f028-40bf-ab58-6b5bcfe354ed req-747b42d5-94fa-41d4-a1ec-1d8b426b1600 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:11.655918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-9e6e2409-f028-40bf-ab58-6b5bcfe354ed req-747b42d5-94fa-41d4-a1ec-1d8b426b1600 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:11.677847 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-9e6e2409-f028-40bf-ab58-6b5bcfe354ed req-747b42d5-94fa-41d4-a1ec-1d8b426b1600 service nova] Creating event network-changed:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:18:11.687590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-9e6e2409-f028-40bf-ab58-6b5bcfe354ed req-747b42d5-94fa-41d4-a1ec-1d8b426b1600 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067572 Aug 01 15:18:11.689122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 261/535] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:12.324575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:18:12.325174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:18:12.507204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:12.508250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:12.522985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.523447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.524545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:12.524999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:12.879641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:12.893734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bae0c422-abe9-43df-9c2e-69f5cbaf15bb tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.390265 Aug 01 15:18:12.896339 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 275/536] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:12 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:13.713827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:13.714412 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:13.722330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.723115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.724411 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.725107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.730011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}, {"name": "network-changed", "server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:13.742808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.743458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.758282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] Creating event network-changed:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:18:13.758929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] Creating event network-changed:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:18:13.765881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-2158ac60-76cc-4239-80a0-9ab390c4dbed req-53a3830f-9866-45d6-9b2f-436c93936d12 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040347 Aug 01 15:18:13.769981 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 276/537] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:13.873511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lazy-loading 'services' on Instance uuid f31193dd-2776-405f-a686-13074d1c4923 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:13.920025 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:13.921382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:13.932170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.932660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:13.933452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:13.933888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.027878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-33f35ce9-4a38-47f4-9708-25d93d9fb696 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments/53a784ab-8778-4373-aced-d9699b98e9ca" status: 202 len: 0 microversion: 2.1 time: 0.319189 Aug 01 15:18:14.028860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 262/538] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:18:13 2022] DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments/53a784ab-8778-4373-aced-d9699b98e9ca => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:14.039950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:14.046020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:14.055454 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:14.056100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.057176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:14.057658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:14.103178 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-24104abb-31a6-4b59-ba17-e371d773b31b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069079 Aug 01 15:18:14.108600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 263/539] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:18:14 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:14.207114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:14.223023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-071af3bd-236f-4ad4-b01b-0be116c05d60 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.307820 Aug 01 15:18:14.223638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 277/540] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:13 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:15.118694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:15.121841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:15.135862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.137072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.138379 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.139216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.187836 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bd4e6758-5a05-44d1-ab68-231c90c6246a tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073907 Aug 01 15:18:15.189139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 264/541] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:18:15 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:18:15.202201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:15.202796 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:15.209735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.210190 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.210971 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.211404 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.246290 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:15.248102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:15.255445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.256360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.257303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.258712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.356664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] HTTP exception thrown: Instance f31193dd-2776-405f-a686-13074d1c4923 is not attached to volume 53a784ab-8778-4373-aced-d9699b98e9ca Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Request method failure captured: Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments/53a784ab-8778-4373-aced-d9699b98e9ca HTTP/1.1 Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-3LATx5751YYSrRl53vNAoywPxhqxKy7AYILu4OCiCWp0-8sGZY7MDSVVUQvXCGbnJnEkh1BV2oG2cA4gP2hTR_-sMV_T7AwfnI6mqZfMhgHLgC1n0HIt5O_4YqAvHvypyRiWwmpfv7fAQWF5tboOJwEifMCZ3hSC9ovMTfupBYIeQ Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 03ff255ce0464ad49313432927bb4daf Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:18:15.374596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_03ff255ce0464ad49313432927bb4daf", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 03ff255ce0464ad49313432927bb4daf Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-TestMinimumBasicScenario-532686050-project Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 16f05877e10442d2a8938f6805eff842 Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-TestMinimumBasicScenario-532686050-project Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:18:15.377709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance f31193dd-2776-405f-a686-13074d1c4923 is not attached to volume 53a784ab-8778-4373-aced-d9699b98e9ca Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'server_id': 'f31193dd-2776-405f-a686-13074d1c4923', 'id': '53a784ab-8778-4373-aced-d9699b98e9ca'} Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 53a784ab-8778-4373-aced-d9699b98e9ca. Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:15.380188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31193dd-2776-405f-a686-13074d1c4923 is not attached to volume 53a784ab-8778-4373-aced-d9699b98e9ca Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31193dd-2776-405f-a686-13074d1c4923 is not attached to volume 53a784ab-8778-4373-aced-d9699b98e9ca Aug 01 15:18:15.385748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:15.391530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Returning 404 to user: Instance f31193dd-2776-405f-a686-13074d1c4923 is not attached to volume 53a784ab-8778-4373-aced-d9699b98e9ca {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:15.393581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-27907575-5732-4b7b-bbf8-492db37e0a70 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments/53a784ab-8778-4373-aced-d9699b98e9ca" status: 404 len: 154 microversion: 2.1 time: 0.195542 Aug 01 15:18:15.396811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 278/542] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:18:15 2022] DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923/os-volume_attachments/53a784ab-8778-4373-aced-d9699b98e9ca => generated 154 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:18:15.476997 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-b1904a24-b814-4c85-a993-50f2201744f9 req-3daaee35-4c81-4391-973c-0def52d95829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4919bd3e-4151-4ecf-ae29-6bc5c3086e90", "name": "network-vif-plugged", "status": "completed", "tag": "6badacde-1e04-4d6e-b3ca-915f3ab74e5a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:15.497726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b1904a24-b814-4c85-a993-50f2201744f9 req-3daaee35-4c81-4391-973c-0def52d95829 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:15.498595 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b1904a24-b814-4c85-a993-50f2201744f9 req-3daaee35-4c81-4391-973c-0def52d95829 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:15.523460 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-b1904a24-b814-4c85-a993-50f2201744f9 req-3daaee35-4c81-4391-973c-0def52d95829 service nova] Creating event network-vif-plugged:6badacde-1e04-4d6e-b3ca-915f3ab74e5a for instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 on hv-cinder-80382 Aug 01 15:18:15.532399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-b1904a24-b814-4c85-a993-50f2201744f9 req-3daaee35-4c81-4391-973c-0def52d95829 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064839 Aug 01 15:18:15.533966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 279/543] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:15.645945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:15.657628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bd28d299-3d2d-41f1-bf30-7731093f0f2b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.414934 Aug 01 15:18:15.659717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 265/544] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:15 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:16.657901 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:16.658528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:16.660652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:16.667257 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.667715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.668593 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.669043 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.693114 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:16.693845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:16.696578 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=4 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:16.698250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=16 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:16.700069 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:18:16.705356 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.705918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.706723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.707165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.794565 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-80197b0a-9fa7-4346-a894-8294914314e5 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 204 len: 0 microversion: 2.1 time: 0.140936 Aug 01 15:18:16.795873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 280/545] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:18:16 2022] DELETE /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:18:16.806783 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:16.807571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:16.814975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.815450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.816232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:16.816724 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:16.901151 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:16.909102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-334deab1-427a-4641-8da4-b22247639b74 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.220078 Aug 01 15:18:16.909703 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 266/546] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:16 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:16.980546 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:16.989408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-abaacaa5-d4a2-4e56-a465-6de99fdbd71e tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1553 microversion: 2.1 time: 0.187067 Aug 01 15:18:16.989889 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 281/547] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:16 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:17.942596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:17.943518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:17.950690 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:17.951153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:17.951982 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:17.952420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.014558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:18.017184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:18.040992 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.041795 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.043155 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:18.043994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:18.116413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:18.124905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b6c62629-c690-4af0-9080-89294b4d979b tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1362 microversion: 2.1 time: 0.186242 Aug 01 15:18:18.125515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 267/548] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:17 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:18.217034 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:18.230760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-05effd72-1069-42e1-be32-46ec27fe7a9c tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1553 microversion: 2.1 time: 0.222912 Aug 01 15:18:18.232217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 282/549] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:18 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:19.146064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:19.146880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:19.153967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.154428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.155227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.155678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.254687 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:19.255701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:19.263396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.263882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.264854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.265178 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.347183 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:19.355527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e9f3b97d-568f-4c4c-a6f5-24bdf9b7fdce tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1548 microversion: 2.1 time: 0.213149 Aug 01 15:18:19.355527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 268/550] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:19 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:19.378031 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:19.378524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:19.388580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.389033 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.389856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:19.390300 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:19.431814 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:19.460059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-19b6a30f-39e6-4092-8989-485834d64086 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1553 microversion: 2.1 time: 0.208547 Aug 01 15:18:19.461201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 283/551] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:19 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:19.485230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-17eb43ed-bc9e-4487-8bd4-56be8823bbf7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111325 Aug 01 15:18:19.485831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 269/552] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:18:19 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:18:20.501389 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:20.502625 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:20.512269 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:20.512756 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:20.514201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:20.514201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:20.715084 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:20.725206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-05d95694-c24b-4566-bdb8-bfbf8ee5450f tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1553 microversion: 2.1 time: 0.231244 Aug 01 15:18:20.726262 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 284/553] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:20 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:21.173559 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-f8d9221e-bd15-4a35-bb38-28224d90a1c8 req-8fdc0a52-7c87-4e84-a0f5-541e5b7bdd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31193dd-2776-405f-a686-13074d1c4923", "name": "network-vif-deleted", "tag": "87b90173-3201-499e-b0ba-c81666855480"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:21.195783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f8d9221e-bd15-4a35-bb38-28224d90a1c8 req-8fdc0a52-7c87-4e84-a0f5-541e5b7bdd5e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.197060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f8d9221e-bd15-4a35-bb38-28224d90a1c8 req-8fdc0a52-7c87-4e84-a0f5-541e5b7bdd5e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.217752 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-f8d9221e-bd15-4a35-bb38-28224d90a1c8 req-8fdc0a52-7c87-4e84-a0f5-541e5b7bdd5e service nova] Creating event network-vif-deleted:87b90173-3201-499e-b0ba-c81666855480 for instance f31193dd-2776-405f-a686-13074d1c4923 on hv-cinder-80382 Aug 01 15:18:21.226863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-f8d9221e-bd15-4a35-bb38-28224d90a1c8 req-8fdc0a52-7c87-4e84-a0f5-541e5b7bdd5e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061462 Aug 01 15:18:21.228262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 270/554] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:21.749199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:21.749831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:21.757878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.758602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.759672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.760328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.779592 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:21.818174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:21.818956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:21.819994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lazy-loading 'fault' on Instance uuid f31193dd-2776-405f-a686-13074d1c4923 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:21.875709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16f05877e10442d2a8938f6805eff842', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ff255ce0464ad49313432927bb4daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:21.886449 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-57f7555b-167e-4e38-8b8d-33c7b4c00994 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 200 len: 1348 microversion: 2.1 time: 0.141991 Aug 01 15:18:21.887798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 285/555] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:21 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 1348 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:22.911826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:22.912419 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] [instance: f31193dd-2776-405f-a686-13074d1c4923] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:22.919916 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.920362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.921179 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:22.921621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:22.938410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] HTTP exception thrown: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Request method failure captured: Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 HTTP/1.1 Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-3LATx5751YYSrRl53vNAoywPxhqxKy7AYILu4OCiCWp0-8sGZY7MDSVVUQvXCGbnJnEkh1BV2oG2cA4gP2hTR_-sMV_T7AwfnI6mqZfMhgHLgC1n0HIt5O_4YqAvHvypyRiWwmpfv7fAQWF5tboOJwEifMCZ3hSC9ovMTfupBYIeQ Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 03ff255ce0464ad49313432927bb4daf Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:18:22.940096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_03ff255ce0464ad49313432927bb4daf", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/03ff255ce0464ad49313432927bb4daf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 03ff255ce0464ad49313432927bb4daf Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestMinimumBasicScenario-532686050 Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestMinimumBasicScenario-532686050-project Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 16f05877e10442d2a8938f6805eff842 Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestMinimumBasicScenario-532686050-project Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. Aug 01 15:18:22.941910 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'f31193dd-2776-405f-a686-13074d1c4923'} Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:22.942835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. Aug 01 15:18:22.944557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:22.945953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Returning 404 to user: Instance f31193dd-2776-405f-a686-13074d1c4923 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:22.945953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c0e04c61-2710-4de6-bafe-4a03bcf2bb81 tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923" status: 404 len: 111 microversion: 2.1 time: 0.034297 Aug 01 15:18:22.945953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 271/556] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:22 2022] GET /compute/v2.1/servers/f31193dd-2776-405f-a686-13074d1c4923 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:18:22.950967 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4986ec6-e48b-43c8-a13c-5301bf5ed13b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] Calling method '.version_select at 0x7fc9ec7d4820>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:22.974622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4986ec6-e48b-43c8-a13c-5301bf5ed13b tempest-TestMinimumBasicScenario-532686050 tempest-TestMinimumBasicScenario-532686050-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287703795" status: 202 len: 0 microversion: 2.1 time: 0.027627 Aug 01 15:18:22.975217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 286/557] 10.222.0.93 () {58 vars in 1269 bytes} [Mon Aug 1 15:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-287703795 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:23.251124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-23f7c007-59b2-448c-93ab-618b92e6cd20 req-45f29486-4ffe-4925-8bab-069202465bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4919bd3e-4151-4ecf-ae29-6bc5c3086e90", "tag": "6badacde-1e04-4d6e-b3ca-915f3ab74e5a"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:23.267844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-23f7c007-59b2-448c-93ab-618b92e6cd20 req-45f29486-4ffe-4925-8bab-069202465bb8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:23.268382 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-23f7c007-59b2-448c-93ab-618b92e6cd20 req-45f29486-4ffe-4925-8bab-069202465bb8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:23.281485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-23f7c007-59b2-448c-93ab-618b92e6cd20 req-45f29486-4ffe-4925-8bab-069202465bb8 service nova] Creating event network-changed:6badacde-1e04-4d6e-b3ca-915f3ab74e5a for instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 on hv-cinder-80382 Aug 01 15:18:23.287378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-23f7c007-59b2-448c-93ab-618b92e6cd20 req-45f29486-4ffe-4925-8bab-069202465bb8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042557 Aug 01 15:18:23.287982 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 272/558] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:25.503540 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:25.504953 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:25.513378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.513916 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.514820 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.515353 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.614357 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lazy-loading 'services' on Instance uuid 74538684-8b00-48aa-9cff-ca522553b4c3 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:25.702107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-87f51f7c-46f1-4172-9500-99603a96ffd7 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments/cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3" status: 202 len: 0 microversion: 2.1 time: 0.203032 Aug 01 15:18:25.703340 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 287/559] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:18:25 2022] DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments/cd7599ed-2020-4f53-be3d-3e9f7e0d7cb3 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:25.715366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:25.718813 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:25.728312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.729703 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.730807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:25.731434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:25.778099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2f3792b1-621a-4635-9cc1-b59e106b916c tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068230 Aug 01 15:18:25.779250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 273/560] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:18:25 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:26.805055 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:26.807806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:26.815113 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.815811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.816808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.817401 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.851483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9e42b88e-4162-4356-b6f0-1689f5867be5 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063493 Aug 01 15:18:26.852093 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 288/561] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:18:26 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:18:26.951709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:26.952277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:26.959643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.960101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:26.960915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:26.961669 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.000076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:18:27.132060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-108cdfc8-560b-4414-8b0a-0d27a8f48065 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 204 len: 0 microversion: 2.1 time: 0.183834 Aug 01 15:18:27.136561 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 274/562] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:18:26 2022] DELETE /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:18:27.143964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:27.144970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:27.163047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.163863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.164884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:27.165594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:27.446616 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:27.454422 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0b81915d-47db-42f6-b461-7edfa1992512 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1688 microversion: 2.1 time: 0.315335 Aug 01 15:18:27.455219 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 289/563] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:27 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1688 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:28.478661 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:28.480097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:28.487319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.487826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.488677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:28.489218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:28.644225 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:28.651999 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-86cb6f9b-ab74-4164-903b-fc4c3eaea39f tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1688 microversion: 2.1 time: 0.179908 Aug 01 15:18:28.652644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 275/564] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:28 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:29.673763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:29.674390 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:29.681952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:29.682415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:29.683223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:29.684376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:29.962602 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:29.971996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d16ce5fe-84ee-498e-b8c4-b2bd5ce881f1 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1688 microversion: 2.1 time: 0.301916 Aug 01 15:18:29.972741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 290/565] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:29 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1688 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:30.995155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:30.995771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:31.002761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.003219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.004008 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:31.004456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:31.247510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:31.255758 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-981cd86e-9c8b-4c23-87ff-597dd1179b84 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1688 microversion: 2.1 time: 0.264329 Aug 01 15:18:31.258877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 276/566] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:30 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1688 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:32.252229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-93553fe8-7449-4dad-9322-9547fd9f82db req-f8fbd8ae-2b2b-4c73-aa5d-12d95e328ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74538684-8b00-48aa-9cff-ca522553b4c3", "name": "network-vif-deleted", "tag": "3422c55b-4a86-4cee-8859-0d36793e92e9"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:32.263445 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-93553fe8-7449-4dad-9322-9547fd9f82db req-f8fbd8ae-2b2b-4c73-aa5d-12d95e328ade service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.264002 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-93553fe8-7449-4dad-9322-9547fd9f82db req-f8fbd8ae-2b2b-4c73-aa5d-12d95e328ade service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.277476 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-93553fe8-7449-4dad-9322-9547fd9f82db req-f8fbd8ae-2b2b-4c73-aa5d-12d95e328ade service nova] Creating event network-vif-deleted:3422c55b-4a86-4cee-8859-0d36793e92e9 for instance 74538684-8b00-48aa-9cff-ca522553b4c3 on hv-cinder-80382 Aug 01 15:18:32.284041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-93553fe8-7449-4dad-9322-9547fd9f82db req-f8fbd8ae-2b2b-4c73-aa5d-12d95e328ade service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349340 Aug 01 15:18:32.285040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:32.286012 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 291/567] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:32.286431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:32.294217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.294645 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.295176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.295658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.313689 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:32.335849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:32.336398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:32.337084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lazy-loading 'fault' on Instance uuid 74538684-8b00-48aa-9cff-ca522553b4c3 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:32.381623 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:32.391162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6d5e0445-c058-4a78-8d0f-837ee10b552d tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 200 len: 1335 microversion: 2.1 time: 0.112013 Aug 01 15:18:32.392193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 277/568] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:32 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:33.439566 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:33.440629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 74538684-8b00-48aa-9cff-ca522553b4c3] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:33.457346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.458158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.459482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:33.460117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:33.478163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] HTTP exception thrown: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Request method failure captured: Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 HTTP/1.1 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-1-2vSqWBuWhaSq4AEzY4TXCnlOWyl3WITgcy8evJh2I_YwHwPgR3Wxm-f1JkEfRxcUTIwey0kbWMQrQSpWv3xau-Zy5Bn33Sc5FSDvrkKFx-uYqa3MmdrXseXKXeR6ySD-_KFOw1PV0Rx1hAbBqhbhdlMjPw9BQAhUZQ-ljrAbc20 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:18:33.480523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_29b33a1fb52146918d3c0bd0d23d2dfa", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3af3a5c1c2f94e51bee936b4762dc14c Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. Aug 01 15:18:33.482770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '74538684-8b00-48aa-9cff-ca522553b4c3'} Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:33.484011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. Aug 01 15:18:33.487396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:18:33.489963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Returning 404 to user: Instance 74538684-8b00-48aa-9cff-ca522553b4c3 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:33.489963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-20dd62e8-452d-4263-ab2b-a64ea3819c20 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3" status: 404 len: 111 microversion: 2.1 time: 0.050111 Aug 01 15:18:33.489963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 292/569] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:33 2022] GET /compute/v2.1/servers/74538684-8b00-48aa-9cff-ca522553b4c3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:18:33.495866 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-63b379af-172f-4daa-9657-9eec957b9379 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '.version_select at 0x7fc9ec14f5e0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:33.520774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-63b379af-172f-4daa-9657-9eec957b9379 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944780468" status: 202 len: 0 microversion: 2.1 time: 0.029663 Aug 01 15:18:33.524586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 278/570] 10.222.0.93 () {58 vars in 1221 bytes} [Mon Aug 1 15:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944780468 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:18:36.769695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:36.770169 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:36.777099 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.777675 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.778629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.779358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.807954 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:18:36.931172 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ad8cc29d-3f31-42df-a471-78d3f0705738 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 204 len: 0 microversion: 2.1 time: 0.165691 Aug 01 15:18:36.932382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 293/571] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:18:36 2022] DELETE /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:18:36.951981 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:36.954041 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:36.972641 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.974514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:36.975906 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:36.976860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:37.222259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:37.235047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-89e041bd-9119-4429-aee0-6d97d165ebba tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1509 microversion: 2.1 time: 0.297245 Aug 01 15:18:37.236533 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 279/572] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:36 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:38.259929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:38.260815 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:38.263131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:38.270561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.271121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:38.271927 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:38.272568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:38.436397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:38.451526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4d81de0-9546-40d3-b53b-08de51138806 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1509 microversion: 2.1 time: 0.195869 Aug 01 15:18:38.452391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 294/573] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:38 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:18:39.476051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:39.477970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:39.489231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:39.490308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:39.491733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:39.492731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:39.805240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:39.829918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-37b4c3fc-0d70-462e-b7ab-37b5c9a9fd09 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 200 len: 1509 microversion: 2.1 time: 0.355215 Aug 01 15:18:39.843029 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 280/574] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:39 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:40.174874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-0d0ebf03-98d4-4dc0-8cf3-34a8b95c51d5 req-fc2d5c30-ff68-4d28-943c-9b2268191084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af7cd8a-b958-4f36-97eb-54d514cd3989", "name": "network-vif-deleted", "tag": "16fdef4d-62ea-4f57-8f5b-39a4f91caec2"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:40.196204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-0d0ebf03-98d4-4dc0-8cf3-34a8b95c51d5 req-fc2d5c30-ff68-4d28-943c-9b2268191084 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.197042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-0d0ebf03-98d4-4dc0-8cf3-34a8b95c51d5 req-fc2d5c30-ff68-4d28-943c-9b2268191084 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.214576 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-0d0ebf03-98d4-4dc0-8cf3-34a8b95c51d5 req-fc2d5c30-ff68-4d28-943c-9b2268191084 service nova] Creating event network-vif-deleted:16fdef4d-62ea-4f57-8f5b-39a4f91caec2 for instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 on hv-cinder-80382 Aug 01 15:18:40.231586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-0d0ebf03-98d4-4dc0-8cf3-34a8b95c51d5 req-fc2d5c30-ff68-4d28-943c-9b2268191084 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061229 Aug 01 15:18:40.232621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 295/575] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:40.858156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:40.859407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 6af7cd8a-b958-4f36-97eb-54d514cd3989] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:40.862929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:40.872393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.872989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.874015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.874574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.899567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] HTTP exception thrown: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Request method failure captured: Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 HTTP/1.1 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-2vSqWBuWhaSq4AEzY4TXCnlOWyl3WITgcy8evJh2I_YwHwPgR3Wxm-f1JkEfRxcUTIwey0kbWMQrQSpWv3xau-Zy5Bn33Sc5FSDvrkKFx-uYqa3MmdrXseXKXeR6ySD-_KFOw1PV0Rx1hAbBqhbhdlMjPw9BQAhUZQ-ljrAbc20 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:18:40.901386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_29b33a1fb52146918d3c0bd0d23d2dfa", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 3af3a5c1c2f94e51bee936b4762dc14c Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. Aug 01 15:18:40.903014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '6af7cd8a-b958-4f36-97eb-54d514cd3989'} Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:40.903932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. Aug 01 15:18:40.905456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:40.906925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Returning 404 to user: Instance 6af7cd8a-b958-4f36-97eb-54d514cd3989 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:40.906925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5f39caba-657b-4b7b-8f41-33cbe78fc219 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989" status: 404 len: 111 microversion: 2.1 time: 0.051243 Aug 01 15:18:40.906925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 281/576] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:40 2022] GET /compute/v2.1/servers/6af7cd8a-b958-4f36-97eb-54d514cd3989 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:18:40.913495 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:40.914243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:40.923301 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.923925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.925064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:40.925758 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:40.955841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:18:41.051946 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-77fb1c8e-de21-4cb8-980f-c2f57ce3871b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "DELETE /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 204 len: 0 microversion: 2.1 time: 0.142756 Aug 01 15:18:41.053261 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 296/577] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:18:40 2022] DELETE /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:18:41.075586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:41.076240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:41.083609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.084062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.084960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:41.088551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:41.275949 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:41.284238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3617e6e2-d20a-44d3-a70a-7216b3c6ddef tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.218147 Aug 01 15:18:41.286816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 282/578] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:41 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:42.308958 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:42.310448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:42.325211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.325903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.326801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:42.327547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:42.579676 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:42.592071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9f275f6a-2a00-4bc9-baea-b2cb170ba3f3 tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.288145 Aug 01 15:18:42.593160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 297/579] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:42 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:43.618173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:43.618944 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:43.628789 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.629508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:43.630480 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:43.631084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:43.911201 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:43.922061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-28c9e13c-0472-4be3-8356-ab5606dcb76a tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.305856 Aug 01 15:18:43.923218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 283/580] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:43 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:44.460730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3b4041d8-968c-4685-9214-d3a6ed92e696 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Action: 'create', calling method: .version_select at 0x7fc9ec815670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1645580769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2za52EqDU4MzPnBcvxVw4s4UtsSC7mutOpWlX+sU9kPb3TSCYJ4OYwKAA1qbSqpzZNwADt6/JSUgrRkiQtfCpnDIzF0jSzu8d2gnzzztjVlenLfHvAl7L7UCSP4byVlQ=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:44.479785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-3b4041d8-968c-4685-9214-d3a6ed92e696 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Getting quotas for project 0dbf7f1737834b12a093b137169033c5. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:18:44.484556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-3b4041d8-968c-4685-9214-d3a6ed92e696 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Getting quotas for user 31789e13f7824dae998c99eefc7aaaaf and project 0dbf7f1737834b12a093b137169033c5. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:18:44.514367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3b4041d8-968c-4685-9214-d3a6ed92e696 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235509 Aug 01 15:18:44.514962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 298/581] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:18:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:44.945101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:44.946275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:44.953374 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:44.954091 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:44.954877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:44.955312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:45.333802 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af3a5c1c2f94e51bee936b4762dc14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b33a1fb52146918d3c0bd0d23d2dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:45.353023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b4f28f9c-9b4b-4801-a270-aa0dab8615aa tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 200 len: 1523 microversion: 2.1 time: 0.410029 Aug 01 15:18:45.356596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 284/582] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:44 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:18:45.358444 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-89e761ba-cb0f-4e45-811a-7a5e425de923 req-3e760015-bc16-4d66-82f0-807fe0928d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a4af5a-02a1-4627-b6cf-6d04fa59a5ee", "name": "network-vif-deleted", "tag": "1a839c00-ef8e-4234-8be0-c00f74498522"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:45.370358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-89e761ba-cb0f-4e45-811a-7a5e425de923 req-3e760015-bc16-4d66-82f0-807fe0928d7f service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:45.370848 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-89e761ba-cb0f-4e45-811a-7a5e425de923 req-3e760015-bc16-4d66-82f0-807fe0928d7f service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:45.383774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-89e761ba-cb0f-4e45-811a-7a5e425de923 req-3e760015-bc16-4d66-82f0-807fe0928d7f service nova] Creating event network-vif-deleted:1a839c00-ef8e-4234-8be0-c00f74498522 for instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee on hv-cinder-80382 Aug 01 15:18:45.392428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-89e761ba-cb0f-4e45-811a-7a5e425de923 req-3e760015-bc16-4d66-82f0-807fe0928d7f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037653 Aug 01 15:18:45.394466 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 299/583] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:18:46.400279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:46.401821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] [instance: 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:46.413798 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:46.414483 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:46.415751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:46.416359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:46.436277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] HTTP exception thrown: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Request method failure captured: Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee HTTP/1.1 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-2vSqWBuWhaSq4AEzY4TXCnlOWyl3WITgcy8evJh2I_YwHwPgR3Wxm-f1JkEfRxcUTIwey0kbWMQrQSpWv3xau-Zy5Bn33Sc5FSDvrkKFx-uYqa3MmdrXseXKXeR6ySD-_KFOw1PV0Rx1hAbBqhbhdlMjPw9BQAhUZQ-ljrAbc20 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:18:46.438456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_29b33a1fb52146918d3c0bd0d23d2dfa", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/29b33a1fb52146918d3c0bd0d23d2dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 29b33a1fb52146918d3c0bd0d23d2dfa Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-790441805 Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 3af3a5c1c2f94e51bee936b4762dc14c Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-ServerRescueNegativeTestJSON-790441805-project Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. Aug 01 15:18:46.440115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '17a4af5a-02a1-4627-b6cf-6d04fa59a5ee'} Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:18:46.441616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. Aug 01 15:18:46.444020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:18:46.448314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] Returning 404 to user: Instance 17a4af5a-02a1-4627-b6cf-6d04fa59a5ee could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:18:46.448314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6305168e-85e4-439f-81dc-75746069d22b tempest-ServerRescueNegativeTestJSON-790441805 tempest-ServerRescueNegativeTestJSON-790441805-project] 10.222.0.93 "GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee" status: 404 len: 111 microversion: 2.1 time: 0.045748 Aug 01 15:18:46.448314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 285/584] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:18:46 2022] GET /compute/v2.1/servers/17a4af5a-02a1-4627-b6cf-6d04fa59a5ee => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:18:55.684425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=4 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:55.685283 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:55.685910 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:55.690232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:55.691167 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:55.699164 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:55.699610 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:55.700380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:55.700851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:55.730654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-30cc1ff6-0202-4e1e-aa36-380a926c2ff3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/ips" status: 200 len: 150 microversion: 2.20 time: 0.047714 Aug 01 15:18:55.731354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 300/585] 10.222.0.93 () {60 vars in 1289 bytes} [Mon Aug 1 15:18:55 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:18:57.795795 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:18:57.797210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:57.799558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=9 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:57.800200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=39 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:18:57.806248 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:57.806708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:57.807479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:57.807917 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:57.834065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lazy-loading 'flavor' on Instance uuid 89484cce-c3a0-432f-98a4-a0c1da1fbf94 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:18:58.025716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ba7f02fd-5700-4823-a44e-fc7bada5a273 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/action" status: 202 len: 0 microversion: 2.20 time: 0.233789 Aug 01 15:18:58.026306 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 286/586] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Aug 1 15:18:57 2022] POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:18:58.035965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:58.036608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:58.044896 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:58.045437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:58.046915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:58.047552 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:58.229266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:58.237892 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:58.239401 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:58.240715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f7dae945-bb7c-48d6-98ae-f986f697e31a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.210040 Aug 01 15:18:58.241522 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 301/587] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:58 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:18:59.265438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:18:59.266174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:18:59.273481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:59.273930 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:59.274726 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:18:59.275164 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:18:59.431893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:59.445255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:59.447089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:18:59.448397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-942a8d53-3437-4662-89ed-67c480e0edba tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.188645 Aug 01 15:18:59.449059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 287/588] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:18:59 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:00.472121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:00.472809 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:00.480095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:00.480599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:00.481366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:00.481812 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:00.635644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:00.644911 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:00.646414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:00.647598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f089811e-8543-4275-acc6-dce2fac7b281 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.180171 Aug 01 15:19:00.648156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 302/589] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:00 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:01.670268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:01.670871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:01.677948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:01.678397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:01.679165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:01.679594 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:01.818443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:01.826876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:01.828441 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:01.829786 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cec8596f-d95f-41a3-a3ff-ee379f8196e1 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.163580 Aug 01 15:19:01.830537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 288/590] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:01 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:02.859813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:02.860438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:02.872556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:02.873320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:02.874866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:02.875440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:03.025096 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:03.034313 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:03.035818 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:03.037033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cd2d2d03-8f0d-4e74-843c-c45b907cee63 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.183505 Aug 01 15:19:03.037597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 303/591] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:02 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:03.526495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2007413660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1645580769", "security_groups": [{"name": "tempest-secgroup-smoke-1306719701"}], "networks": [{"uuid": "b74765d8-29a1-4f9d-9a03-9e5a36fff53a"}], "block_device_mapping_v2": [{"uuid": "6db2d6f1-347e-48fb-8540-875e75e561d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:03.646677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] validate_networks() for [('b74765d8-29a1-4f9d-9a03-9e5a36fff53a', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:19:04.064908 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:04.066197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:04.078725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:04.079653 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:04.082428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:04.083240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:04.208195 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:19:04.208648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:19:04.209263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:19:04.209785 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:19:04.210292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:19:04.221231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:04.221796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:04.222691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:04.223200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:04.246417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Getting quotas for project 0dbf7f1737834b12a093b137169033c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:19:04.254435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Getting quotas for user 31789e13f7824dae998c99eefc7aaaaf and project 0dbf7f1737834b12a093b137169033c5. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:19:04.260582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:04.270904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:04.273392 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:04.275446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6fc47b70-f5ea-40d8-a3e3-2ed35a4b7c55 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.218376 Aug 01 15:19:04.276302 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 304/592] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:04 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:04.332648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:19:04.334770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6db2d6f1-347e-48fb-8540-875e75e561d4',volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:19:04.509261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d31014d8-f1f3-4a38-9277-c08d54180fb6 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.986264 Aug 01 15:19:04.511007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 289/593] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:19:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:19:04.521964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a7d76d35-027a-4da0-a165-950f0d494d93 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:04.522579 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a7d76d35-027a-4da0-a165-950f0d494d93 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:04.593059 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a7d76d35-027a-4da0-a165-950f0d494d93 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:04.602873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a7d76d35-027a-4da0-a165-950f0d494d93 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1089 microversion: 2.1 time: 0.084668 Aug 01 15:19:04.603681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 305/594] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:04 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:05.136418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:05.137731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:05.145442 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.146104 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.146820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.147345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.177374 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-31516be3-a129-4138-aede-704caa2c9f43 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/ips" status: 200 len: 146 microversion: 2.1 time: 0.046648 Aug 01 15:19:05.178078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 290/595] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:19:05 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:05.300729 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:05.301537 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:05.315460 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.316589 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.317433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.317877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.511288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:05.529362 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:05.532625 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:05.534629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5415f4ad-bf6a-438a-aea3-a169964b607e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.238002 Aug 01 15:19:05.535180 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 306/596] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:05 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:05.625197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:05.625842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:05.634374 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.635126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.636281 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:05.636973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:05.707015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:05.715250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8e1b54e2-97c1-43c2-9919-5ac1c8dab0f5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1187 microversion: 2.1 time: 0.094940 Aug 01 15:19:05.715875 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 291/597] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:05 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:06.566166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:06.566844 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:06.574871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.575327 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:06.576343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.576860 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:06.669765 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ffd4130-f427-41d5-a114-dbc86809ffff"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:06.673674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:06.684312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.684974 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:06.685926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.687142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:06.784842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:06.808193 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:06.816348 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:06.818015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5a39a5b6-3514-4507-87bd-747a5188902f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.256507 Aug 01 15:19:06.818711 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 307/598] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:06 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:06.823600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:06.824325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:06.834294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.835088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:06.835681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:06.836127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:07.071739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:07.091176 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f9b93505-a6ea-4805-9eda-1b15ead9ad7f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.269581 Aug 01 15:19:07.092201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 308/599] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:06 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:07.173844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fcec643b-3c93-4a3c-81a0-9b00da966e7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508265 Aug 01 15:19:07.175007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 292/600] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:19:06 2022] POST /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:19:07.847336 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:07.848290 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:07.861364 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:07.862106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:07.863529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:07.864283 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:08.082462 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:08.091950 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:08.093547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:08.094761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a711d6c1-814a-444f-98f3-4b7afd48f88f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.253138 Aug 01 15:19:08.095328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 309/601] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:07 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:08.128687 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:08.129503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:08.136772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:08.137366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:08.138173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:08.138620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:08.366809 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-0cbe195a-474a-41da-b921-014d2876845a req-cf7418dd-82f1-40a9-a00d-9eaf1f158289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:08.383873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-0cbe195a-474a-41da-b921-014d2876845a req-cf7418dd-82f1-40a9-a00d-9eaf1f158289 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:08.384643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-0cbe195a-474a-41da-b921-014d2876845a req-cf7418dd-82f1-40a9-a00d-9eaf1f158289 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:08.399214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-0cbe195a-474a-41da-b921-014d2876845a req-cf7418dd-82f1-40a9-a00d-9eaf1f158289 service nova] Creating event network-changed:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:19:08.406200 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-0cbe195a-474a-41da-b921-014d2876845a req-cf7418dd-82f1-40a9-a00d-9eaf1f158289 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045581 Aug 01 15:19:08.407480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 310/602] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:08.498447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:08.515408 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9a246c69-14ee-44fd-beba-38cf358a93ec tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.390806 Aug 01 15:19:08.516146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 293/603] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:08 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:09.119700 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:09.120693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:09.128480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:09.128947 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:09.129852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:09.130188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:09.364559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:09.389352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:09.393232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:09.395575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ce7a906-632f-49cb-9c6d-f3192fdf294b tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.280703 Aug 01 15:19:09.396899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 311/604] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:09 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:09.549440 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:09.551247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:09.561294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:09.561806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:09.563242 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:09.563792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:09.969272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:09.980830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9aca810b-47db-4e9a-8e0b-de5391ee2899 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.436959 Aug 01 15:19:10.001622 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 294/605] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:09 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:10.423624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:10.425251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:10.433087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:10.433641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:10.434524 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:10.435035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:10.606787 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:10.617654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:10.619792 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:10.621358 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5c385ceb-8996-40ce-bc34-c715f8a811a2 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.203065 Aug 01 15:19:10.622055 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 312/606] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:10 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:11.010158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:11.010885 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:11.019106 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:11.019620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:11.020406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:11.020887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:11.169868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:11.182596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0251c3a4-998f-4892-9527-15d0ad459883 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.173067 Aug 01 15:19:11.182596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 295/607] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:11 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:11.646334 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:11.646837 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:11.653626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:11.654067 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:11.655789 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:11.656225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:11.817442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:11.827470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:11.829143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:11.830407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6397876a-94dd-4dc0-891e-a3ec971ef570 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.188156 Aug 01 15:19:11.830992 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 313/608] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:11 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:12.201677 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:12.202777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:12.211724 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:12.212433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:12.213879 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:12.214659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:12.409747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:12.418088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-072f7ba2-5a52-4d5b-bc1c-21f2f9d70569 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.220944 Aug 01 15:19:12.418685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 296/609] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:12 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:12.856349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:12.857206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:12.864143 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:12.864641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:12.865433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:12.865876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:13.052993 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:13.063237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:13.065627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:13.067151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5b72a6c3-b4b3-488d-91ee-21a651353258 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.215460 Aug 01 15:19:13.068323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 314/610] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:12 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:13.439651 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:13.440336 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:13.448864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:13.449788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:13.451121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:13.452061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:13.613212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:13.625762 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5b7765ce-64cb-4ad8-b38a-aa6a1948b455 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.189978 Aug 01 15:19:13.626818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 297/611] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:13 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:14.091813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:14.093030 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:14.099568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.100022 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.100831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.101272 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.240372 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:14.248198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:14.249739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:14.250940 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dc126c3c-bcfb-447c-afbb-22f7b1c4511d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1741 microversion: 2.20 time: 0.163702 Aug 01 15:19:14.251488 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 315/612] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:14 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:14.648211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:14.649247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:14.651173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:14.651854 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:14.659787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.660383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.661073 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.661524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.836922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:14.847426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4521e69b-8b61-47ba-a318-3a4ce4dcb51c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.203539 Aug 01 15:19:14.865294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 298/613] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:14 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:14.921988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:14.924016 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:14.926194 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:14.931479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.931931 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.932817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.933355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.970380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-23baccb8-79fc-487b-b77b-29fecc8b8820 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053130 Aug 01 15:19:14.971086 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 316/614] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:19:14 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:19:14.982480 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:14.983631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:14.991061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.991519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:14.992609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:14.993569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:15.025012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d4bc467a-ee81-4cac-9860-438f4c89c62f tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff" status: 200 len: 194 microversion: 2.1 time: 0.046792 Aug 01 15:19:15.025644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 299/615] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Aug 1 15:19:14 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:15.276606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:15.277070 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:15.284904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:15.285450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:15.286308 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:15.286884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:15.457159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:15.467666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:15.469225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:15.470397 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dc90126d-bfd2-4b0e-8287-9f1f2fb999fe tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1741 microversion: 2.20 time: 0.198800 Aug 01 15:19:15.470959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 317/616] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:15 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:15.875904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:15.876576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:15.883701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:15.884140 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:15.885142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:15.885592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:15.890570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:16.049400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:16.058457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d4e9a1c0-afc4-4f53-bbfb-a78db3c5c4f2 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.186971 Aug 01 15:19:16.059155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 300/617] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:15 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:16.458094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a333f77b-c283-4a81-9df3-2b949780304c"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:16.462040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:16.469913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:16.470654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:16.471949 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:16.472751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:16.495681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:16.502198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:16.503526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:16.513553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:16.514808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:16.515685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:16.516129 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:16.726572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:16.738361 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:16.740032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:16.741689 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f6e52965-dfd5-4b4a-aa92-7d77497ff95e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1741 microversion: 2.20 time: 0.244421 Aug 01 15:19:16.742286 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 301/618] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:16 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:16.854769 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a28dbe74-d516-4e6a-b63c-9ce39e6d01fa tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "POST /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402313 Aug 01 15:19:16.855636 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 318/619] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:19:16 2022] POST /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:17.080328 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:17.080976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:17.087874 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:17.088340 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:17.089270 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:17.089715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:17.241172 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:17.249693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-aa16ba1c-7567-4817-b6c4-11e2884554e5 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.172504 Aug 01 15:19:17.250198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 302/620] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:17 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:17.770195 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:17.771259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:17.781870 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:17.782675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:17.784167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:17.784946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:17.927813 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-51d5f659-1030-4471-811f-aab94eeb9cc8 req-94649615-cec0-4c14-a6d7-66676b14d831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "name": "network-vif-plugged", "status": "completed", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:17.944324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-51d5f659-1030-4471-811f-aab94eeb9cc8 req-94649615-cec0-4c14-a6d7-66676b14d831 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:17.946991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-51d5f659-1030-4471-811f-aab94eeb9cc8 req-94649615-cec0-4c14-a6d7-66676b14d831 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:17.992793 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-51d5f659-1030-4471-811f-aab94eeb9cc8 req-94649615-cec0-4c14-a6d7-66676b14d831 service nova] Creating event network-vif-plugged:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:19:17.997682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-51d5f659-1030-4471-811f-aab94eeb9cc8 req-94649615-cec0-4c14-a6d7-66676b14d831 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310116 Aug 01 15:19:17.999399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 319/621] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:18.015037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:18.023929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:18.025679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:18.026958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-18f0834c-5de6-4a46-87f9-0fe1157325e4 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.262393 Aug 01 15:19:18.032534 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 303/622] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:17 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:18.271911 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:18.272609 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:18.280547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:18.281234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:18.282344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:18.282956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:18.470336 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:18.479537 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6634784c-39d2-45b5-b25b-039ec4a284ad tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.212293 Aug 01 15:19:18.481000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 320/623] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:18 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:19.052417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:19.053072 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:19.062100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:19.062556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:19.063366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:19.063792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:19.248659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:19.259839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:19.262157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:19.264119 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-634b45ab-595e-40bb-a2de-94778b56c14c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.215657 Aug 01 15:19:19.265057 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 304/624] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:19 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:19.513777 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:19.515517 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:19.523754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:19.524215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:19.527255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:19.527255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:19.746067 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:19.761292 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb4aeece-89b0-4f02-8570-edf7bece2dbf tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.261264 Aug 01 15:19:19.774949 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 321/625] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:19 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:20.015327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-5da485eb-dadc-4c11-bb5c-33055cde7e78 req-ea8cd085-cd74-42b5-9ec9-7d8de671eb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "name": "network-vif-plugged", "status": "completed", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:20.027859 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5da485eb-dadc-4c11-bb5c-33055cde7e78 req-ea8cd085-cd74-42b5-9ec9-7d8de671eb83 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:20.028699 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5da485eb-dadc-4c11-bb5c-33055cde7e78 req-ea8cd085-cd74-42b5-9ec9-7d8de671eb83 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:20.042358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-5da485eb-dadc-4c11-bb5c-33055cde7e78 req-ea8cd085-cd74-42b5-9ec9-7d8de671eb83 service nova] Creating event network-vif-plugged:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:19:20.048155 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-5da485eb-dadc-4c11-bb5c-33055cde7e78 req-ea8cd085-cd74-42b5-9ec9-7d8de671eb83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037081 Aug 01 15:19:20.049054 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 305/626] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:20.295409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:20.296414 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:20.316644 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:20.317451 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:20.318257 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:20.319010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:20.614785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:20.624209 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:20.627774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:20.630037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-38e55100-9e03-494e-80ad-2c2bdff48807 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.341401 Aug 01 15:19:20.630634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 322/627] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:20 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:20.796134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:20.799806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:20.813529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:20.814380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:20.816104 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:20.816957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:21.075188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:21.088404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d597b115-1735-4b24-9e10-2e2297b355df tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1261 microversion: 2.1 time: 0.303868 Aug 01 15:19:21.104979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 306/628] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:20 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:21.661472 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:21.663452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:21.677588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:21.700082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:21.708601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:21.709661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:21.954039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:21.964383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:21.966538 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:21.969158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-be7f814c-9620-498a-9728-08ad9ff2b1ee tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.316385 Aug 01 15:19:21.970270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 323/629] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:21 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:22.123179 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:22.124592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:22.142214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.145113 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.146361 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.147062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.469956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:22.486633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2e0bdd6e-9a61-4bb8-934f-d8aee8fd8d0a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1446 microversion: 2.1 time: 0.368598 Aug 01 15:19:22.493010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 307/630] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:22 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1446 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:22.510191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:22.511066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:22.521442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.522134 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.523217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:22.523661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:22.680877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:22.690534 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-faf41138-55f0-40ee-bff1-74ebfade164d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1446 microversion: 2.1 time: 0.184059 Aug 01 15:19:22.691118 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 324/631] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:22 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:22.998882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:23.000400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:23.010210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:23.010791 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:23.012007 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:23.012541 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:23.306460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:23.350102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:23.351733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:23.357038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-81e6ecb1-8aa3-4825-867d-fb1abfdf28bd tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.364672 Aug 01 15:19:23.362375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 308/632] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:22 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:24.383525 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:24.384772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:24.398349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.398810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.400101 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.400101 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.653455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:24.680078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:24.680657 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:24.682244 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:24.683591 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:24.689748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ffb5a310-8a58-424a-bd9a-245a382680f3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.305405 Aug 01 15:19:24.697727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.698583 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.700075 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.700719 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.705732 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 325/633] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:24 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:24.747735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4bf677f7-284a-4984-9b05-754d83459653 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.071455 Aug 01 15:19:24.749764 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 309/634] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:19:24 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:24.895635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:24.896636 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:24.923692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.926508 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.927462 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:24.929888 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:24.989570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f38eae6d-72f5-4a14-a166-a59b81b39b00 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff" status: 200 len: 194 microversion: 2.1 time: 0.100295 Aug 01 15:19:24.991612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 326/635] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Aug 1 15:19:24 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:25.002070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:25.002783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:25.014924 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.016185 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.020234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.021852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.172378 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lazy-loading 'services' on Instance uuid 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:19:25.290122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-60de1aed-3fab-45b0-837b-dc6f49ea5e52 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff" status: 202 len: 0 microversion: 2.1 time: 0.290561 Aug 01 15:19:25.291157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 310/636] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:19:24 2022] DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/5ffd4130-f427-41d5-a114-dbc86809ffff => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:19:25.714881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:25.715319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:25.722887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.723604 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:25.729523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:25.729999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:26.006295 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:26.034363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:26.046811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:26.051253 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-93777f1b-75c6-4e36-afbd-7ac5ed8888b3 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.340529 Aug 01 15:19:26.054798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 327/637] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:25 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:26.222308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-05650a0a-91cd-4a8e-814e-6509dfec3f8a req-2f23bdf8-b34d-49c9-8dad-fd24464d4be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:26.255354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-05650a0a-91cd-4a8e-814e-6509dfec3f8a req-2f23bdf8-b34d-49c9-8dad-fd24464d4be7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:26.257161 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-05650a0a-91cd-4a8e-814e-6509dfec3f8a req-2f23bdf8-b34d-49c9-8dad-fd24464d4be7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:26.275294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-05650a0a-91cd-4a8e-814e-6509dfec3f8a req-2f23bdf8-b34d-49c9-8dad-fd24464d4be7 service nova] Creating event network-changed:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:19:26.295303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-05650a0a-91cd-4a8e-814e-6509dfec3f8a req-2f23bdf8-b34d-49c9-8dad-fd24464d4be7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077666 Aug 01 15:19:26.301073 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 311/638] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:27.078427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:27.079048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:27.088088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=59 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:27.092071 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.093174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.094242 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.094894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.359012 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:27.375878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:27.377503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:27.378713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-68866ff5-1817-4867-9c02-ee3e4ebe8e22 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.304140 Aug 01 15:19:27.379287 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 328/639] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:27 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:27.652117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:27.652748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:27.671112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.671571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.672366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.672839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.715670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5a52ae5e-4479-4ffd-98f6-47702ca7936e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/a333f77b-c283-4a81-9df3-2b949780304c" status: 200 len: 194 microversion: 2.1 time: 0.068385 Aug 01 15:19:27.716377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 312/640] 10.222.0.93 () {58 vars in 1413 bytes} [Mon Aug 1 15:19:27 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/a333f77b-c283-4a81-9df3-2b949780304c => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:27.731227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:27.732032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:27.747717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.749563 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.751389 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:27.751845 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:27.895395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lazy-loading 'services' on Instance uuid 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:19:28.022185 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e5497d2a-6cda-4ce7-96bf-0fa4ffc47df5 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/a333f77b-c283-4a81-9df3-2b949780304c" status: 202 len: 0 microversion: 2.1 time: 0.297522 Aug 01 15:19:28.025536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 329/641] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:19:27 2022] DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments/a333f77b-c283-4a81-9df3-2b949780304c => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:19:28.407637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:28.409143 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:28.418086 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:28.421398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:28.422071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:28.423547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:28.424159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:28.628654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:28.638177 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:28.649245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:28.650617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5fd48ecf-dbec-4fcb-934f-509a9ca4c748 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.248795 Aug 01 15:19:28.651259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 313/642] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:28 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:29.308354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:29.311666 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:29.320082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.320863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.321850 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.322452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.393276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-752677b5-04d4-408a-8882-f8b1c0e3a41e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089483 Aug 01 15:19:29.394349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 330/643] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:19:29 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 15:19:29.667657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:29.676023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:29.676286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:29.676741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:29.684751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.685203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.686790 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.687516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.689823 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.690894 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.692560 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.693748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.757938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7da4c438-d253-42fa-a6cc-8f0826fd270a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098650 Aug 01 15:19:29.764861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 314/644] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:19:29 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:19:29.876690 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:29.883951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:29.884438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:29.894492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:29.898011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:29.898406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.900182 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.900963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:29.901159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1df4fe4b-19e3-4a93-b88d-07366c5dda13 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.228613 Aug 01 15:19:29.901400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:29.902826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 331/645] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:29 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:29.930882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:19:29.995079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:30.031694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ffb766bd-8adb-417a-8af9-61638427395e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 204 len: 0 microversion: 2.1 time: 0.150571 Aug 01 15:19:30.031941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 315/646] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:19:29 2022] DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:19:30.041400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:30.042701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:30.052638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:30.053095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:30.056376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:30.057170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:30.213995 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:30.222310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-173f9634-9927-4df5-ab28-6088fc654048 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1673 microversion: 2.1 time: 0.185904 Aug 01 15:19:30.222913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 332/647] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:30 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:30.926887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:30.927507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:30.934224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:30.934710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:30.936122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:30.936518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:31.083001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:31.091169 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:31.093229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:31.094511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-70564031-2b86-445f-86ae-9405f15326af tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1736 microversion: 2.20 time: 0.171992 Aug 01 15:19:31.095140 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 316/648] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:30 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:31.244518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:31.245083 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:31.251503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:31.251952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:31.252747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:31.253204 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:31.387218 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:31.391259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:31.396275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf018169-b52a-4636-a069-972bd653a472 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1673 microversion: 2.1 time: 0.155759 Aug 01 15:19:31.396923 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 333/649] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:31 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:32.119334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:32.120088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:32.127743 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:32.128189 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:32.129051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:32.129588 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:32.418243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:32.418839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:32.428592 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:32.429104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:32.430169 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:32.430675 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:32.472724 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:32.483638 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:32.485771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:32.487117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d25613eb-da64-48e2-a90e-98889377015f tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1718 microversion: 2.20 time: 0.371679 Aug 01 15:19:32.487716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 317/650] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:32 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1718 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:32.599396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:32.608931 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-719d614f-4179-4413-ba3f-26a0584c08b0 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1673 microversion: 2.1 time: 0.194468 Aug 01 15:19:32.610236 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 334/651] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:32 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:33.512912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:33.513579 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:33.521925 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:33.522800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:33.523826 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:33.524265 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:33.571652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-911e5901-8a96-4a4f-acf9-52391289348e req-3fa7a3d4-47a8-4778-98be-c9b9cae41825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4919bd3e-4151-4ecf-ae29-6bc5c3086e90", "name": "network-vif-deleted", "tag": "6badacde-1e04-4d6e-b3ca-915f3ab74e5a"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:33.583275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-911e5901-8a96-4a4f-acf9-52391289348e req-3fa7a3d4-47a8-4778-98be-c9b9cae41825 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:33.588003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-911e5901-8a96-4a4f-acf9-52391289348e req-3fa7a3d4-47a8-4778-98be-c9b9cae41825 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:33.605203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-911e5901-8a96-4a4f-acf9-52391289348e req-3fa7a3d4-47a8-4778-98be-c9b9cae41825 service nova] Creating event network-vif-deleted:6badacde-1e04-4d6e-b3ca-915f3ab74e5a for instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 on hv-cinder-80382 Aug 01 15:19:33.614903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-911e5901-8a96-4a4f-acf9-52391289348e req-3fa7a3d4-47a8-4778-98be-c9b9cae41825 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044960 Aug 01 15:19:33.614903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 335/652] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:19:33.630981 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:33.634303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:33.650279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:33.651084 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:33.654347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:33.655588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:33.736376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:33.748659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:33.750786 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:33.752295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-caa14f40-2693-4efc-916d-5fb54d18ce6d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1718 microversion: 2.20 time: 0.243792 Aug 01 15:19:33.753434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 318/653] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:33 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1718 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:33.787271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:33.798399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c7cf38dd-9489-4530-854b-99643aa20438 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1605 microversion: 2.1 time: 0.171849 Aug 01 15:19:33.799963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 336/654] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:33 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1605 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:34.775955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:34.777078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:34.785303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:34.785904 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:34.788139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:34.788139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:34.824809 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:34.825921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:34.837722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:34.838824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:34.839933 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:34.840554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:34.940757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a49850f6d8a474d83821f5f49dff06c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '916870664da8419eb5466fd75b15987d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:34.950731 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b661639c-7060-45b3-a441-a4ef7d736019 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 200 len: 1321 microversion: 2.1 time: 0.133086 Aug 01 15:19:34.953285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 337/655] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:34 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 1321 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:34.957278 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:34.973934 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:34.977229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:34.979146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d250647f-60d1-4f05-9592-560b2e857df6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1718 microversion: 2.20 time: 0.207561 Aug 01 15:19:34.980529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 319/656] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:34 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1718 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:35.767229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-9e5d8af6-e7cc-4ab0-b33f-286f72e6110f req-539fa587-810c-49c6-b89c-e2b7b526a678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "name": "network-vif-unplugged", "status": "completed", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:35.779986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9e5d8af6-e7cc-4ab0-b33f-286f72e6110f req-539fa587-810c-49c6-b89c-e2b7b526a678 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:35.780394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9e5d8af6-e7cc-4ab0-b33f-286f72e6110f req-539fa587-810c-49c6-b89c-e2b7b526a678 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:35.793558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.compute.server_external_events [req-9e5d8af6-e7cc-4ab0-b33f-286f72e6110f req-539fa587-810c-49c6-b89c-e2b7b526a678 service nova] Unable to find a host for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94. Dropping event network-vif-unplugged {{(pid=117993) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 15:19:35.795325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-9e5d8af6-e7cc-4ab0-b33f-286f72e6110f req-539fa587-810c-49c6-b89c-e2b7b526a678 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031541 Aug 01 15:19:35.796140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 338/657] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 15:19:35.972674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:35.973326 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:35.980430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:35.980915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:35.981701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:35.982643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:35.996702 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 HTTP/1.1 Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:19:35.998953 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:36.000665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '4919bd3e-4151-4ecf-ae29-6bc5c3086e90'} Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:36.001619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:36.003138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:36.004857 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:36.005485 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:36.005839 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:36.006714 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-19ff6052-1b31-48b8-805f-afacb827717d tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 404 len: 111 microversion: 2.1 time: 0.037908 Aug 01 15:19:36.007283 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 320/658] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:35 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:36.012698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.013222 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:36.014214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.014687 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:36.017472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6aa31f41-c547-4a80-9fa2-4de042329a7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '.version_select at 0x7fc9ec08b0d0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:36.041688 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6aa31f41-c547-4a80-9fa2-4de042329a7e tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301399490" status: 202 len: 0 microversion: 2.1 time: 0.028621 Aug 01 15:19:36.042825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 321/659] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Aug 1 15:19:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301399490 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:19:36.243771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:36.257672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:36.259561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:36.260827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b99ebf8c-a717-4a61-9444-244c358a9162 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1661 microversion: 2.20 time: 0.260236 Aug 01 15:19:36.261386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 339/660] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:35 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1661 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:36.285340 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b155742c-a1fa-4cf8-9907-c85002c80343"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:36.290120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:36.297753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.298364 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:36.299294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.299868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:36.662545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d9a936ff-c822-48ee-bddb-55053e799068 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.380952 Aug 01 15:19:36.663645 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 322/661] 10.222.0.93 () {62 vars in 1364 bytes} [Mon Aug 1 15:19:36 2022] POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments => generated 188 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 15:19:36.854787 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:36.855349 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:36.864270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.865686 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:36.867094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:36.867367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:37.173991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-017de6ce-f665-434f-ae7d-2db07a05e22e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments/b155742c-a1fa-4cf8-9907-c85002c80343" status: 202 len: 0 microversion: 2.20 time: 0.324480 Aug 01 15:19:37.174634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 340/662] 10.222.0.93 () {60 vars in 1457 bytes} [Mon Aug 1 15:19:36 2022] DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments/b155742c-a1fa-4cf8-9907-c85002c80343 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:19:37.241442 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:37.242048 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:37.249201 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:37.249640 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:37.250404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:37.251059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:37.282944 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117992) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:19:37.352838 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-53e82386-71f2-4422-8611-b96e141176c9 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/action" status: 202 len: 0 microversion: 2.20 time: 0.115412 Aug 01 15:19:37.353871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 323/663] 10.222.0.93 () {62 vars in 1319 bytes} [Mon Aug 1 15:19:37 2022] POST /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:19:37.362238 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:37.362879 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:37.370520 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:37.370626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:37.371343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:37.371819 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:37.535777 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:37.545562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:37.547133 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:37.548303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b9af5c5d-8de6-46d7-8f03-323b30c39bac tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1669 microversion: 2.20 time: 0.189978 Aug 01 15:19:37.549347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 341/664] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:37 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:38.572354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:38.573615 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:38.580542 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:38.580997 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:38.582355 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:38.582786 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:38.729092 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:38.738609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:38.740128 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:38.741352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a33b4c6e-d190-4538-a3cd-012d2ee07065 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1671 microversion: 2.20 time: 0.173068 Aug 01 15:19:38.742000 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 324/665] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:38 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:39.247661 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:39.249133 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:39.256672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.262033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.263801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.264318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.282376 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 HTTP/1.1 Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:19:39.284065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.285755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '4919bd3e-4151-4ecf-ae29-6bc5c3086e90'} Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:39.286671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.288124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.290985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:39.292053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5661dcb2-444a-4baa-98d3-e73e6258f11a tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 404 len: 111 microversion: 2.1 time: 0.048989 Aug 01 15:19:39.292829 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 342/666] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:19:39 2022] DELETE /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:39.302577 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:39.304011 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: 4919bd3e-4151-4ecf-ae29-6bc5c3086e90] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:39.310611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.311140 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.311920 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.312476 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.327459 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 HTTP/1.1 Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:19:39.329154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.330905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '4919bd3e-4151-4ecf-ae29-6bc5c3086e90'} Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:39.331796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. Aug 01 15:19:39.333562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:39.335263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance 4919bd3e-4151-4ecf-ae29-6bc5c3086e90 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:39.335263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-435c0671-5cb4-4013-83a7-1563e30922df tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90" status: 404 len: 111 microversion: 2.1 time: 0.032231 Aug 01 15:19:39.335263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 325/667] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:39 2022] GET /compute/v2.1/servers/4919bd3e-4151-4ecf-ae29-6bc5c3086e90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:39.766806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:39.767329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:39.774659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.775142 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.776007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:39.776392 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:39.924444 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:39.932805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:39.934299 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:39.935597 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4c997bc6-ee1e-4f90-aaf8-284601a3a37e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.173202 Aug 01 15:19:39.937082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 343/668] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:39 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:40.502734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:40.503940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:40.513714 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.514165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.514945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.515495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.534614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 HTTP/1.1 Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:19:40.536705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.538037 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'dde1d20a-c1e7-4321-bdd2-a74e52f66489'} Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:40.538831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.540280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.543062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:40.545428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7c28b3fa-c237-4363-8d8e-262f92e14eb7 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 404 len: 111 microversion: 2.1 time: 0.046994 Aug 01 15:19:40.546618 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 326/669] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:19:40 2022] DELETE /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:40.554344 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:40.557313 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] [instance: dde1d20a-c1e7-4321-bdd2-a74e52f66489] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:40.571668 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.572124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.572940 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.573369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.588214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] HTTP exception thrown: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Request method failure captured: Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 HTTP/1.1 Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-1-3Eju6kWFwspf0t7E4KEZN9nd0Dy8RhGkT2LcvP2n57Wtt65xUt7CtlEi4rcWcrT2RVhtiphXYwqVXLo_gyXSQXSLogR766Pkhu_ZKfXmThySwSocvLecpqMetU350aLJjc2zhihVfJIHBJxk3doEPHPvoWrIKa-vR9Hr5nete2k Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:19:40.590072 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_916870664da8419eb5466fd75b15987d", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/916870664da8419eb5466fd75b15987d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/916870664da8419eb5466fd75b15987d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 916870664da8419eb5466fd75b15987d Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-812313385 Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 5a49850f6d8a474d83821f5f49dff06c Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeTestJSON-812313385-project Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.591803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'dde1d20a-c1e7-4321-bdd2-a74e52f66489'} Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:40.592745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. Aug 01 15:19:40.594359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:19:40.595744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] Returning 404 to user: Instance dde1d20a-c1e7-4321-bdd2-a74e52f66489 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:40.595744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb90cdfd-e482-4d57-baaf-89f692770ca6 tempest-AttachVolumeTestJSON-812313385 tempest-AttachVolumeTestJSON-812313385-project] 10.222.0.93 "GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489" status: 404 len: 111 microversion: 2.1 time: 0.041069 Aug 01 15:19:40.595744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 344/670] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:40 2022] GET /compute/v2.1/servers/dde1d20a-c1e7-4321-bdd2-a74e52f66489 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:19:40.960360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:40.961478 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:40.968931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.969615 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:40.970597 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:40.971354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:41.249137 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:41.270303 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:41.272528 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:41.274358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-93bdfe23-7a86-4040-a67c-04b952639729 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.318085 Aug 01 15:19:41.275120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 327/671] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:40 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:19:42.301440 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:42.302482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:42.311113 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:42.311592 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:42.312454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:42.312921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:42.698457 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:42.707912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:42.709640 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:42.710907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4c38dd5c-be65-46d3-a23c-ad6525d1f419 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.414833 Aug 01 15:19:42.711946 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 345/672] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:42 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:43.755261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:43.755877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:43.766078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:43.766828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:43.767886 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:43.768516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:44.027941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:44.040308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:44.045988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:44.048837 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b3ed39c0-d722-4163-a4e0-2a4ea79f99a0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.296380 Aug 01 15:19:44.053168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 328/673] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:43 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:45.086131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:45.087323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:45.108129 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:45.108554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:45.117409 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:45.118424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:45.367383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:45.384709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:45.386692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:45.389771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f54abb34-2ddd-4683-8803-c6a4a0087acc tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.314763 Aug 01 15:19:45.390752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 346/674] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:45 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:46.420434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:46.421088 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:46.429397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:46.433871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:46.433871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:46.433871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:46.731489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:46.742294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:46.744339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:46.746070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-59b10b77-5d76-4ee2-89a7-7cbb3f0d8f51 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.329945 Aug 01 15:19:46.747239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 329/675] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:46 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:47.775203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:47.776634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:47.808582 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:47.810746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:47.818408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.825635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:47.829321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.830876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:47.844530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.849108 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:47.851417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:47.854703 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:47.965800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:19:48.051890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:48.184284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-880b1703-ab6d-44ef-a771-e149b2ab35c3 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 204 len: 0 microversion: 2.1 time: 0.385457 Aug 01 15:19:48.189979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 330/676] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:19:47 2022] DELETE /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:19:48.204230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:48.205498 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:48.222290 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:48.222799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:48.226580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:48.227289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:48.257056 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:48.280599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:48.282880 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:48.286456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-81cec915-f6cc-4003-b459-0029e6802cf8 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.515538 Aug 01 15:19:48.290561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 347/677] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:47 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:48.502405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:48.522586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c9f4ad9e-6bd1-4416-b10f-37d16f4a2757 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1578 microversion: 2.1 time: 0.326673 Aug 01 15:19:48.523995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 331/678] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:48 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1578 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:49.314600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:49.315282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:49.321983 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.322428 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.323549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.324147 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.507243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:49.516659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:49.518378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:49.520013 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-23e8aeb6-5b72-4224-a813-8ab4561c150d tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.209398 Aug 01 15:19:49.520804 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 348/679] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:49 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:49.551014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:49.551751 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:49.559079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.559643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.560365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:49.560855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:49.733131 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:49.742582 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-56f129a8-5581-44a3-b8d2-b44a368401af tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1578 microversion: 2.1 time: 0.195346 Aug 01 15:19:49.744210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 332/680] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:49 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:50.546085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:50.546785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:50.553547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.554003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.554890 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.555441 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.723590 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:50.734090 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:50.735631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:50.736894 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-456aba09-62f0-43d6-941e-9b14afd07548 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.195320 Aug 01 15:19:50.737444 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 349/681] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:50 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:50.769279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:50.771545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:50.787914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.788533 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.789582 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:50.790030 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:50.951916 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:50.960518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fa5a23b5-b53a-4c8d-a3a0-fecbf3d4f7a9 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1578 microversion: 2.1 time: 0.199686 Aug 01 15:19:50.961665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 333/682] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:50 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:51.761528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:51.762247 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:51.771267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:51.772076 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:51.775454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:51.775912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:51.983856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:51.985254 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:51.999690 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:52.000671 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:52.002214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:52.004634 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:52.043125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:52.046240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:52.067878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:52.069660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:52.070882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78ff7587-3747-4840-99a6-24d62c3f0619 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.313395 Aug 01 15:19:52.086685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 350/683] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:51 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:52.321850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:52.330517 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-697ca88d-5bd7-44d2-ae75-f59af8a12dd8 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1578 microversion: 2.1 time: 0.350933 Aug 01 15:19:52.345466 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 334/684] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:51 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1578 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:19:52.968287 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-9e12dfab-46d9-4280-bb25-f0bb4c3a6566 req-68948733-91d5-410b-a4b3-8bd627759d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0de715-716c-4c4b-8bef-f9be4a2ab216", "name": "network-vif-deleted", "tag": "5a318c7f-a2a9-4a98-a77a-46d0604f8ec4"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:52.981412 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9e12dfab-46d9-4280-bb25-f0bb4c3a6566 req-68948733-91d5-410b-a4b3-8bd627759d79 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:52.982604 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-9e12dfab-46d9-4280-bb25-f0bb4c3a6566 req-68948733-91d5-410b-a4b3-8bd627759d79 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.021536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-9e12dfab-46d9-4280-bb25-f0bb4c3a6566 req-68948733-91d5-410b-a4b3-8bd627759d79 service nova] Creating event network-vif-deleted:5a318c7f-a2a9-4a98-a77a-46d0604f8ec4 for instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 on hv-cinder-80382 Aug 01 15:19:53.043720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-9e12dfab-46d9-4280-bb25-f0bb4c3a6566 req-68948733-91d5-410b-a4b3-8bd627759d79 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087095 Aug 01 15:19:53.057449 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 351/685] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:53.107413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:53.111454 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.130868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.132337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.134596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.137720 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.365709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:53.369712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:53.392677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.393431 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.394841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:53.395633 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:53.438271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.469911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.474646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.481768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f11b7a36-63d4-4697-bfea-9e0147e09b2a tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.381473 Aug 01 15:19:53.510073 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 335/686] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:53 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:53.587437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:53.601307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4153a61b-0136-4b6e-8ec1-4de9f5a45bf2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 200 len: 1226 microversion: 2.1 time: 0.249830 Aug 01 15:19:53.613133 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 352/687] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:53 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 1226 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:54.093526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-b6f85d11-339a-47c2-8389-e079b566a487 req-6d752af0-603a-48ee-8ff5-3c29c952e7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "name": "network-vif-plugged", "status": "completed", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:54.124089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b6f85d11-339a-47c2-8389-e079b566a487 req-6d752af0-603a-48ee-8ff5-3c29c952e7c0 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.126076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b6f85d11-339a-47c2-8389-e079b566a487 req-6d752af0-603a-48ee-8ff5-3c29c952e7c0 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.142773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-b6f85d11-339a-47c2-8389-e079b566a487 req-6d752af0-603a-48ee-8ff5-3c29c952e7c0 service nova] Creating event network-vif-plugged:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:19:54.149081 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-b6f85d11-339a-47c2-8389-e079b566a487 req-6d752af0-603a-48ee-8ff5-3c29c952e7c0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062165 Aug 01 15:19:54.149694 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 336/688] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:19:54.531681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:54.532547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:54.553094 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.553912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.555304 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.556701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.642915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:54.644874 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:54.655742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.657054 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.658250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:54.659774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:54.677983 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] HTTP exception thrown: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Request method failure captured: Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 HTTP/1.1 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-5Jk9sQT2XDAhMeWTZlKcBevYTjluo1owQxRYb7e58Cyx1Ow-KUOq84f9prTpYWoe_UmZN5OGwRneZwxOHZfLn7KqJoJI4VfSFaMB8g2gSFMhHkeMuKa-17HfGdPM6oJrhzgsW2WCFlskIxDqfZN90ig0FXpD-TuhTQvECGZRdQi3s Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:19:54.680774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_821ce227288a424ea530e4a7c08e41c9", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b687d38492594eab876740bdfb7db9ff Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:19:54.682538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '7a0de715-716c-4c4b-8bef-f9be4a2ab216'} Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:19:54.683857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:19:54.686027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:19:54.691147 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Returning 404 to user: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:19:54.692188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4b4fb6eb-fabd-4d21-8eeb-463a9059b415 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 404 len: 111 microversion: 2.1 time: 0.058105 Aug 01 15:19:54.693330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 337/689] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:54 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:19:54.750968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.765355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.767461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:54.769394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-000d34a4-65b6-49cd-b1a8-6f93538e69a7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.243824 Aug 01 15:19:54.786631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 353/690] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:54 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:54.864094 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-288633568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846126148", "security_groups": [{"name": "tempest-secgroup-smoke-2146828685"}], "block_device_mapping_v2": [{"uuid": "25c9e3c5-7dff-46c0-9ad6-67fe7247ba4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd69fb39-f000-4eff-9ed3-ac19740ad8e8"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:54.993892 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] validate_networks() for [('bd69fb39-f000-4eff-9ed3-ac19740ad8e8', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:19:55.595629 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:19:55.596711 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:19:55.597219 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:19:55.598167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:19:55.598912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:19:55.614133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.614852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.616758 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.618050 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.650020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:19:55.657852 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for user b687d38492594eab876740bdfb7db9ff and project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:19:55.768151 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:19:55.770410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25c9e3c5-7dff-46c0-9ad6-67fe7247ba4f',volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:19:55.796060 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:55.797275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:55.806303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.807061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.808183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:55.808821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:55.955140 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0786c284-db69-43ff-9af3-2c6dd215c358 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095682 Aug 01 15:19:55.956653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 338/691] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:19:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:19:55.972032 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9d478f7d-2928-4af7-b63f-f6ea4ed67ba7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:55.972899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9d478f7d-2928-4af7-b63f-f6ea4ed67ba7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:56.095135 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.103199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9d478f7d-2928-4af7-b63f-f6ea4ed67ba7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.112046 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9d478f7d-2928-4af7-b63f-f6ea4ed67ba7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1094 microversion: 2.1 time: 0.148427 Aug 01 15:19:56.113244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 339/692] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:55 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1094 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:56.122539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.124702 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:56.133328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-39659ee1-0c66-4ddc-b244-3b40e224e8ae tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.342319 Aug 01 15:19:56.150031 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 354/693] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:55 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:57.133858 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:57.134654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:57.167374 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:57.171950 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:57.174912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.175696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.176887 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.177531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.192619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=54 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:19:57.211842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.215495 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.217274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:57.217899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:57.322907 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.334590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f9855091-cfdf-4902-b04e-78551d8518b2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1192 microversion: 2.1 time: 0.205366 Aug 01 15:19:57.335247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 340/694] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:57 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1192 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:57.398842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.408369 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.410750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:57.412162 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5db7dcbf-8ea3-4966-9f73-5897be610e53 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1727 microversion: 2.20 time: 0.256131 Aug 01 15:19:57.412823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 355/695] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:57 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1727 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:58.360629 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:58.363477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:58.376982 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.377769 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.380511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.381311 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.439551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:19:58.440275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:19:58.449319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.449319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.449319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:58.449319 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:58.619116 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.629317 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.631047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.632338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8894447a-6bf1-4e2b-9481-f6796be202a6 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1714 microversion: 2.20 time: 0.200702 Aug 01 15:19:58.648784 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 356/696] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:19:58 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1714 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:19:58.965029 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:19:58.976976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b4236843-5b72-46ad-b60c-d5233c36af9a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1278 microversion: 2.1 time: 0.625089 Aug 01 15:19:58.979097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 341/697] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:58 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1278 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:19:59.858163 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-4c9ec92d-dd5e-47fa-92a6-3c239aece4ee req-f0a6beeb-d7fd-4a88-95f2-9f0d107b34e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27888738-ab49-43c2-9bb9-20cf9a05b232", "tag": "26002b15-aafe-478b-b334-d773a2ef7dc7"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:19:59.877727 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4c9ec92d-dd5e-47fa-92a6-3c239aece4ee req-f0a6beeb-d7fd-4a88-95f2-9f0d107b34e5 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:19:59.878963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-4c9ec92d-dd5e-47fa-92a6-3c239aece4ee req-f0a6beeb-d7fd-4a88-95f2-9f0d107b34e5 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:19:59.901994 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-4c9ec92d-dd5e-47fa-92a6-3c239aece4ee req-f0a6beeb-d7fd-4a88-95f2-9f0d107b34e5 service nova] Creating event network-changed:26002b15-aafe-478b-b334-d773a2ef7dc7 for instance 27888738-ab49-43c2-9bb9-20cf9a05b232 on hv-cinder-80382 Aug 01 15:19:59.907310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-4c9ec92d-dd5e-47fa-92a6-3c239aece4ee req-f0a6beeb-d7fd-4a88-95f2-9f0d107b34e5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060573 Aug 01 15:19:59.907969 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 357/698] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:00.000837 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:00.007911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:00.010942 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:00.025553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.026234 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:00.027813 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:00.030068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:00.288092 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:00.303204 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ea2b8dad-0e77-429a-84f4-f3c63cda1b6e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.306352 Aug 01 15:20:00.304301 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 342/699] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:19:59 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:01.328617 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:01.329468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:01.336202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:01.336685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:01.337494 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:01.337930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:01.524539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:01.536686 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1842ccdb-c6b9-4e0e-a23b-5d6e4e1ed42f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.213412 Aug 01 15:20:01.537770 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 358/700] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:01 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:02.563021 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:02.563996 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:02.574430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.575792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.577269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:02.578040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:02.761557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:02.776613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a7670601-98f3-4775-a8f4-eb94eaa3fed7 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.220041 Aug 01 15:20:02.777599 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 343/701] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:02 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:03.807743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:03.808659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:03.817767 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.817767 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:03.818170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:03.818496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:04.020456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:04.029460 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2d936b72-f5a6-4d5b-8281-0e0292f4d0ac tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.225833 Aug 01 15:20:04.030056 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 359/702] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:03 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:05.056123 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:05.056871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:05.074716 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.079330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.079330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:05.079330 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:05.234849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:05.244647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-dfd2918c-e13a-45aa-9a79-5aa11e729e5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.193155 Aug 01 15:20:05.245243 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 344/703] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:05 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:06.270085 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:06.271876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:06.279096 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:06.279545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:06.280329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:06.280832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:06.437436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:06.445303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-48794e6c-e3e7-4c41-ad26-33340ba73744 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.181816 Aug 01 15:20:06.445891 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 360/704] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:06 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:07.387386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1347365284", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "networks": [{"uuid": "18440bed-6509-4bb8-8ac6-34809cee9afb"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:07.403913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:07.405289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=8 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:07.461011 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] validate_networks() for [('18440bed-6509-4bb8-8ac6-34809cee9afb', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:20:07.469886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:07.470968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:07.479583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.480277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.481880 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.482413 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.659803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:07.675348 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b4afa55e-f71a-4b64-b1d4-03e50fa969b1 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.211090 Aug 01 15:20:07.676309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 361/705] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:07 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:07.892413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:20:07.893320 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:20:07.894227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:20:07.894985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:20:07.895740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:20:07.914413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.915236 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.916794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:07.917513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:07.948782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Getting quotas for project 9c1dffe73f924ee9aa7cffca0fa3d33f. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:20:07.954935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Getting quotas for user aefedc120f4547e0964fb8386f9024dc and project 9c1dffe73f924ee9aa7cffca0fa3d33f. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:20:07.968120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:20:07.970515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:20:08.037433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-580b956f-5379-4601-a760-24a1be9ec14e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656053 Aug 01 15:20:08.038224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 345/706] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:20:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 15:20:08.058159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7d47acec-1410-47df-bea5-c042ef99e12d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:08.060018 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7d47acec-1410-47df-bea5-c042ef99e12d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:08.154307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7d47acec-1410-47df-bea5-c042ef99e12d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.162025 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7d47acec-1410-47df-bea5-c042ef99e12d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1214 microversion: 2.1 time: 0.111249 Aug 01 15:20:08.162973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 362/707] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:08 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:08.701971 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:08.704501 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:08.718097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.719149 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.720376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:08.721880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:08.915333 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:08.925436 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a730ae21-f02a-4b02-8349-e1a0764f0f5d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.230513 Aug 01 15:20:08.926075 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 346/708] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:08 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:09.183756 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:09.184394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:09.193581 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.194032 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.194832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.195274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.305132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:09.313637 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cf63e474-7189-4469-b360-2a92790fa9c0 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1266 microversion: 2.1 time: 0.133800 Aug 01 15:20:09.314632 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 363/709] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:09 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:09.947231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:09.947983 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:09.956136 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.956612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:09.957399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:09.958060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.037367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-5a9db8e2-71f1-44cf-972b-0f2ff09527dd req-2d188bbb-51ea-456f-aca3-530476e5f7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27888738-ab49-43c2-9bb9-20cf9a05b232", "name": "network-vif-plugged", "status": "completed", "tag": "26002b15-aafe-478b-b334-d773a2ef7dc7"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:10.054323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5a9db8e2-71f1-44cf-972b-0f2ff09527dd req-2d188bbb-51ea-456f-aca3-530476e5f7fc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.054823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5a9db8e2-71f1-44cf-972b-0f2ff09527dd req-2d188bbb-51ea-456f-aca3-530476e5f7fc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.250049 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-5a9db8e2-71f1-44cf-972b-0f2ff09527dd req-2d188bbb-51ea-456f-aca3-530476e5f7fc service nova] Creating event network-vif-plugged:26002b15-aafe-478b-b334-d773a2ef7dc7 for instance 27888738-ab49-43c2-9bb9-20cf9a05b232 on hv-cinder-80382 Aug 01 15:20:10.258245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-5a9db8e2-71f1-44cf-972b-0f2ff09527dd req-2d188bbb-51ea-456f-aca3-530476e5f7fc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225582 Aug 01 15:20:10.258954 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 364/710] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:10.322395 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.333126 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cc575b93-59b6-4c8d-876c-fc2a69cb7123 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.389674 Aug 01 15:20:10.333707 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 347/711] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:09 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:10.347081 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:10.347780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:10.354904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.355265 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.356182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:10.356716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:10.550763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:10.558941 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4cfa543a-2683-45d5-bcbf-adf3431b59f1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.215968 Aug 01 15:20:10.560126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 365/712] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:10 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:11.112252 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-4952b42c-995b-4d31-8c2d-3fe8f8947367 req-f049c979-ae6e-4dc7-891b-6e196d9271e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d909e61c-d2bd-459d-81fb-6c99155c9f0f", "tag": "e023d1a3-c675-4ede-ba4b-a2804488f834"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:11.123732 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-4952b42c-995b-4d31-8c2d-3fe8f8947367 req-f049c979-ae6e-4dc7-891b-6e196d9271e7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.124181 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-4952b42c-995b-4d31-8c2d-3fe8f8947367 req-f049c979-ae6e-4dc7-891b-6e196d9271e7 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.135650 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-4952b42c-995b-4d31-8c2d-3fe8f8947367 req-f049c979-ae6e-4dc7-891b-6e196d9271e7 service nova] Creating event network-changed:e023d1a3-c675-4ede-ba4b-a2804488f834 for instance d909e61c-d2bd-459d-81fb-6c99155c9f0f on hv-cinder-80382 Aug 01 15:20:11.140952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-4952b42c-995b-4d31-8c2d-3fe8f8947367 req-f049c979-ae6e-4dc7-891b-6e196d9271e7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032358 Aug 01 15:20:11.141558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 348/713] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:11.359232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:11.359865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:11.366696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.367141 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.367929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.368365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.539386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.548083 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2860da0d-8382-4ccf-b157-ce66c5263ffd tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1266 microversion: 2.1 time: 0.193670 Aug 01 15:20:11.548703 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 366/714] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:11 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:11.583713 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:11.584877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:11.592167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.592685 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.593460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:11.593903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:11.782636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:11.796718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-14ec4408-6c2f-40b1-93fd-2e2624a292fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.218371 Aug 01 15:20:11.797319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 349/715] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:11 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:12.571420 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:12.573047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:12.580351 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.581180 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.582026 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.582650 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.730504 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:12.738914 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7a25cbaa-7d8e-4bff-a32d-36eefd0602aa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1452 microversion: 2.1 time: 0.172190 Aug 01 15:20:12.739489 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 367/716] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:12 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:12.759492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:12.760154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:12.767062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.767514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.768280 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.768750 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.817930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:12.818586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:12.825203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.825742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.826439 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:12.826867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:12.916726 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:12.925336 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-27fac8bc-d562-449f-be04-d17e9637395e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1452 microversion: 2.1 time: 0.169586 Aug 01 15:20:12.925922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 350/717] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:12 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:12.979287 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:12.987705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-488fcd25-7a6d-4da3-ae16-4baf28263ee2 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.173635 Aug 01 15:20:12.988284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 368/718] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:12 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:14.014345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:14.015592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:14.028404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.029293 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.030589 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:14.031508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:14.040684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:14.578439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:14.592078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ba39a2e0-52ec-41d3-b756-b3b09ffb5efc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.585743 Aug 01 15:20:14.592715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 351/719] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:14 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:15.485719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-58077b4e-f6b6-4b63-83a8-33fd308ee45e req-f29072e2-516a-40af-ae91-d6102d565e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27888738-ab49-43c2-9bb9-20cf9a05b232", "tag": "26002b15-aafe-478b-b334-d773a2ef7dc7"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:15.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-58077b4e-f6b6-4b63-83a8-33fd308ee45e req-f29072e2-516a-40af-ae91-d6102d565e97 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.498600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-58077b4e-f6b6-4b63-83a8-33fd308ee45e req-f29072e2-516a-40af-ae91-d6102d565e97 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.513408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-58077b4e-f6b6-4b63-83a8-33fd308ee45e req-f29072e2-516a-40af-ae91-d6102d565e97 service nova] Creating event network-changed:26002b15-aafe-478b-b334-d773a2ef7dc7 for instance 27888738-ab49-43c2-9bb9-20cf9a05b232 on hv-cinder-80382 Aug 01 15:20:15.519699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-58077b4e-f6b6-4b63-83a8-33fd308ee45e req-f29072e2-516a-40af-ae91-d6102d565e97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039193 Aug 01 15:20:15.520437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 369/720] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:15.631164 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:15.633008 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:15.653356 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.654087 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.654931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:15.655380 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:15.941217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:15.956368 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-dcb07134-87f3-4735-b45d-01a9dcd17c3d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.331739 Aug 01 15:20:15.958146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 352/721] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:15 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:17.004048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:17.005809 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:17.028909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.029765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:17.031326 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:17.032135 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:17.272310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:17.287104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4e0099ba-7a9e-411e-91d9-44c4c8d73f23 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.292639 Aug 01 15:20:17.288427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 370/722] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:16 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:18.070890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-45d88bfc-1c24-426a-b09c-fa335f5f4336 req-4f5fba30-ccd5-4bb7-89b6-708365d5a715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d909e61c-d2bd-459d-81fb-6c99155c9f0f", "name": "network-vif-plugged", "status": "completed", "tag": "e023d1a3-c675-4ede-ba4b-a2804488f834"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:18.078245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:18.079150 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:18.089669 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-45d88bfc-1c24-426a-b09c-fa335f5f4336 req-4f5fba30-ccd5-4bb7-89b6-708365d5a715 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:18.090183 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-45d88bfc-1c24-426a-b09c-fa335f5f4336 req-4f5fba30-ccd5-4bb7-89b6-708365d5a715 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:18.111001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-45d88bfc-1c24-426a-b09c-fa335f5f4336 req-4f5fba30-ccd5-4bb7-89b6-708365d5a715 service nova] Creating event network-vif-plugged:e023d1a3-c675-4ede-ba4b-a2804488f834 for instance d909e61c-d2bd-459d-81fb-6c99155c9f0f on hv-cinder-80382 Aug 01 15:20:18.119013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-45d88bfc-1c24-426a-b09c-fa335f5f4336 req-4f5fba30-ccd5-4bb7-89b6-708365d5a715 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052481 Aug 01 15:20:18.120020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 353/723] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:18.313600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:18.314324 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:18.317551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:18.324827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:18.325412 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:18.326217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:18.326659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:18.332050 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=100 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:18.507392 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:18.516053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cd299c42-048e-4946-93c5-4ba3f18b04d8 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.207057 Aug 01 15:20:18.516671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 371/724] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:18 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:19.543886 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:19.545128 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:19.552642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:19.553101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:19.553956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:19.554506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:19.709972 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:19.718408 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a9c12148-9703-4d39-9069-c1ad4f3ec053 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1314 microversion: 2.1 time: 0.183928 Aug 01 15:20:19.719005 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 354/725] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:19 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:20.741499 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:20.742121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:20.750503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.750955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.751737 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:20.752186 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:20.894268 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:20.904337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-abb39f49-0fd3-4280-8a20-fff9ed1ab23e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1498 microversion: 2.1 time: 0.168237 Aug 01 15:20:20.905292 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 372/726] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:20 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1498 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:21.400157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:21.400821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:21.410737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.411459 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.412352 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.412840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.449327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:20:21.553819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-2db2e1e9-b421-4c71-a2ef-ddeca2724503 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 204 len: 0 microversion: 2.1 time: 0.156539 Aug 01 15:20:21.556298 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 355/727] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:20:21 2022] DELETE /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 15:20:21.567846 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:21.568553 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:21.576122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.576821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.579323 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:21.580283 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:21.756019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:21.764148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6281cc64-4041-4589-9e37-78962f0f935d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1504 microversion: 2.1 time: 0.201038 Aug 01 15:20:21.764806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 373/728] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:21 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:22.786362 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:22.787013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:22.794309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.794859 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.795792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:22.795945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:22.931728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:22.939752 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6ac734c5-edf4-4502-89ac-3ff63645de45 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1504 microversion: 2.1 time: 0.157671 Aug 01 15:20:22.940526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 356/729] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:22 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:23.523219 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-8e36c141-a9f3-4d58-a40f-73d6e419ce59 req-8db8a9e7-dc8c-4c79-ac14-5d8cbe20ea83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d909e61c-d2bd-459d-81fb-6c99155c9f0f", "name": "network-vif-deleted", "tag": "e023d1a3-c675-4ede-ba4b-a2804488f834"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:23.534150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8e36c141-a9f3-4d58-a40f-73d6e419ce59 req-8db8a9e7-dc8c-4c79-ac14-5d8cbe20ea83 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.534683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8e36c141-a9f3-4d58-a40f-73d6e419ce59 req-8db8a9e7-dc8c-4c79-ac14-5d8cbe20ea83 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.548033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-8e36c141-a9f3-4d58-a40f-73d6e419ce59 req-8db8a9e7-dc8c-4c79-ac14-5d8cbe20ea83 service nova] Creating event network-vif-deleted:e023d1a3-c675-4ede-ba4b-a2804488f834 for instance d909e61c-d2bd-459d-81fb-6c99155c9f0f on hv-cinder-80382 Aug 01 15:20:23.554820 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-8e36c141-a9f3-4d58-a40f-73d6e419ce59 req-8db8a9e7-dc8c-4c79-ac14-5d8cbe20ea83 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035043 Aug 01 15:20:23.555488 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 374/730] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:23.967165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:23.967805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:23.980110 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.981327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:23.982699 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:23.983395 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:24.021919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:24.022376 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:24.023356 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lazy-loading 'fault' on Instance uuid d909e61c-d2bd-459d-81fb-6c99155c9f0f {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:20:24.070288 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:24.077909 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-972b9d1e-4ebc-4c02-80c2-64bfa54cc680 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 200 len: 1304 microversion: 2.1 time: 0.115177 Aug 01 15:20:24.078571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 357/731] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:23 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:25.100645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:25.101366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: d909e61c-d2bd-459d-81fb-6c99155c9f0f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:25.108151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.108639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.109426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.109866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.124496 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] HTTP exception thrown: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Request method failure captured: Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f HTTP/1.1 Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-8lXaNajjbtq8MqgrmtzO7PF4b62W0Yuf9IYnpZtaHDlB4l8yImtDyjP6McrPGlK-2ZlokxkhTTuWdRS_NOonPplBgMwvQm1IaN1XJFE7BMplWuD2tzm1xk-uIIUNm7zZyhDwg2tt6cpga2fL52G80sY12f4-3rtgSVGJD3KW95sGQ Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 9c1dffe73f924ee9aa7cffca0fa3d33f Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:20:25.126267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c1dffe73f924ee9aa7cffca0fa3d33f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 9c1dffe73f924ee9aa7cffca0fa3d33f Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesActionsTest-1727055058-project Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: aefedc120f4547e0964fb8386f9024dc Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesActionsTest-1727055058-project Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. Aug 01 15:20:25.128693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'd909e61c-d2bd-459d-81fb-6c99155c9f0f'} Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:25.130082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. Aug 01 15:20:25.132922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:25.135359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Returning 404 to user: Instance d909e61c-d2bd-459d-81fb-6c99155c9f0f could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:25.135359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b387ba39-6772-43d6-b107-116c52634104 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f" status: 404 len: 111 microversion: 2.1 time: 0.032036 Aug 01 15:20:25.135359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 375/732] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:25 2022] GET /compute/v2.1/servers/d909e61c-d2bd-459d-81fb-6c99155c9f0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:20:25.179680 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-215200520", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "networks": [{"uuid": "18440bed-6509-4bb8-8ac6-34809cee9afb"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:25.241739 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] validate_networks() for [('18440bed-6509-4bb8-8ac6-34809cee9afb', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:20:25.628136 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:20:25.628610 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:20:25.629180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:20:25.629506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:20:25.629924 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:20:25.638992 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.639440 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.640236 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:25.640723 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:25.659120 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Getting quotas for project 9c1dffe73f924ee9aa7cffca0fa3d33f. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:20:25.664420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Getting quotas for user aefedc120f4547e0964fb8386f9024dc and project 9c1dffe73f924ee9aa7cffca0fa3d33f. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:20:25.678600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:20:25.681123 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:20:25.730279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-95bf9d31-a04b-426e-a1dd-2a12572db6af tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554589 Aug 01 15:20:25.730908 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 358/733] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:20:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:20:25.742396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-adede16f-d8e1-4521-91ca-2da66e50ea6d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:25.743099 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-adede16f-d8e1-4521-91ca-2da66e50ea6d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:25.799603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-adede16f-d8e1-4521-91ca-2da66e50ea6d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:25.806681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-adede16f-d8e1-4521-91ca-2da66e50ea6d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1213 microversion: 2.1 time: 0.068230 Aug 01 15:20:25.807284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 376/734] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:25 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:26.828292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:26.828985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:26.838546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:26.839029 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.839815 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:26.840346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:26.984529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:26.995744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b9a8632a-e968-43e9-b386-b487226b16fc tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1273 microversion: 2.1 time: 0.172075 Aug 01 15:20:26.996565 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 359/735] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:26 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:28.020747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:28.021461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:28.023975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=48 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:28.031434 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.031886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.032702 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.033137 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.186229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:28.194434 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6c8697e6-0563-4426-bf54-8c5aa6c58c7e tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.177475 Aug 01 15:20:28.195100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 377/736] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:28 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:28.868790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-030d2771-7ae5-4dd5-b1d0-7aab14965879 req-fb81d8d0-9bdf-4753-916d-77865a0e9fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e4e597-acbe-4261-b788-514da81ae65a", "tag": "40d206aa-c9fa-4f69-97ce-bb865a72b95b"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:28.885450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-030d2771-7ae5-4dd5-b1d0-7aab14965879 req-fb81d8d0-9bdf-4753-916d-77865a0e9fc8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:28.886648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-030d2771-7ae5-4dd5-b1d0-7aab14965879 req-fb81d8d0-9bdf-4753-916d-77865a0e9fc8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:28.909788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-030d2771-7ae5-4dd5-b1d0-7aab14965879 req-fb81d8d0-9bdf-4753-916d-77865a0e9fc8 service nova] Creating event network-changed:40d206aa-c9fa-4f69-97ce-bb865a72b95b for instance b5e4e597-acbe-4261-b788-514da81ae65a on hv-cinder-80382 Aug 01 15:20:28.918609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-030d2771-7ae5-4dd5-b1d0-7aab14965879 req-fb81d8d0-9bdf-4753-916d-77865a0e9fc8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055329 Aug 01 15:20:28.919914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 360/737] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:29.218959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:29.218959 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:29.226157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.226624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.227538 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:29.228241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:29.395799 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:29.404549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-927a6653-def2-405d-a023-71998fbb451c tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.191846 Aug 01 15:20:29.405132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 378/738] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:29 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:30.426262 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:30.427168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:30.429035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:30.435193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.435696 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.436499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:30.437002 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:30.710820 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:30.720879 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bf311b57-8239-4582-82fe-0dee7db6edb1 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.299241 Aug 01 15:20:30.721491 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 361/739] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:30 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:31.746183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:31.746826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:31.766276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.766937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.768164 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.769627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.774539 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:31.777238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:31.784922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.785505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.786255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.786624 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.824398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-147657a1-c5ff-40e8-a12f-2eb2fd023803 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055166 Aug 01 15:20:31.825428 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 362/740] 10.222.0.93 () {60 vars in 1343 bytes} [Mon Aug 1 15:20:31 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:31.916840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:31.917754 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:31.925822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.926272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.927086 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:31.927514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:31.958109 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:20:31.968693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:31.980775 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c02dbbf5-399f-476a-806a-5b91f4d1c58f tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.241148 Aug 01 15:20:31.981680 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 379/741] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:31 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:32.085294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4f538d64-7275-4342-a854-ffe7554e5f03 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 204 len: 0 microversion: 2.20 time: 0.171588 Aug 01 15:20:32.086575 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 363/742] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Aug 1 15:20:31 2022] DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 15:20:32.096188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:32.096934 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:32.106188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:32.106721 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:32.107437 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:32.107874 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:32.297326 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:32.306175 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:32.307670 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:32.308886 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-16ed76ec-549f-4c85-8cd1-c9672d716dbf tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.217196 Aug 01 15:20:32.310365 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 380/743] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:32 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:33.006410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:33.007284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:33.015193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.015193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.015864 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.016292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.176228 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.185985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c012dea0-ae5b-40d1-b293-dcedabc83a41 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.183802 Aug 01 15:20:33.186575 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 364/744] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:33 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:33.335241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:33.336123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:33.343706 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.343706 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.344828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:33.345083 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:33.514761 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.524174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.525800 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:33.527058 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-30a1f744-515d-4d69-917e-fd09335a74e0 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1720 microversion: 2.20 time: 0.196204 Aug 01 15:20:33.527629 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 381/745] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:33 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:34.148296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-6c12c2fc-064e-43db-b513-c4cb1ba19466 req-52947192-b661-4b04-91a0-84406dd51ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e4e597-acbe-4261-b788-514da81ae65a", "name": "network-vif-plugged", "status": "completed", "tag": "40d206aa-c9fa-4f69-97ce-bb865a72b95b"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:34.161645 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-6c12c2fc-064e-43db-b513-c4cb1ba19466 req-52947192-b661-4b04-91a0-84406dd51ce8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.162556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-6c12c2fc-064e-43db-b513-c4cb1ba19466 req-52947192-b661-4b04-91a0-84406dd51ce8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.177841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-6c12c2fc-064e-43db-b513-c4cb1ba19466 req-52947192-b661-4b04-91a0-84406dd51ce8 service nova] Creating event network-vif-plugged:40d206aa-c9fa-4f69-97ce-bb865a72b95b for instance b5e4e597-acbe-4261-b788-514da81ae65a on hv-cinder-80382 Aug 01 15:20:34.183919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-6c12c2fc-064e-43db-b513-c4cb1ba19466 req-52947192-b661-4b04-91a0-84406dd51ce8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039353 Aug 01 15:20:34.184546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 365/746] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:34.210086 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:34.214014 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:34.238699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.239463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.242905 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.243822 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.464550 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.476748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c4304da7-bdb3-43b7-9ba4-c61b8fc63dbf tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.272403 Aug 01 15:20:34.477357 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 382/747] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:34 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:34.552052 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:34.553224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:34.562501 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.563339 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.564064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.564629 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.689660 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.696849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:34.705132 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.708832 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:34.711594 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-91214e20-f835-4216-b8cd-3075a6653183 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1653 microversion: 2.20 time: 0.163481 Aug 01 15:20:34.713222 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 366/748] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:34 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 15:20:34.825881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-5c49f591-3584-492a-a374-c40ec33663dc req-4b23e7e9-5b15-4bf8-9ebe-9f03f5ab8a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89484cce-c3a0-432f-98a4-a0c1da1fbf94", "name": "network-vif-deleted", "tag": "6f73c8dc-f4da-41a6-9380-8493491ee64d"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:34.841360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5c49f591-3584-492a-a374-c40ec33663dc req-4b23e7e9-5b15-4bf8-9ebe-9f03f5ab8a17 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:34.841989 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5c49f591-3584-492a-a374-c40ec33663dc req-4b23e7e9-5b15-4bf8-9ebe-9f03f5ab8a17 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:34.857861 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-5c49f591-3584-492a-a374-c40ec33663dc req-4b23e7e9-5b15-4bf8-9ebe-9f03f5ab8a17 service nova] Creating event network-vif-deleted:6f73c8dc-f4da-41a6-9380-8493491ee64d for instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 on hv-cinder-80382 Aug 01 15:20:34.870741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-5c49f591-3584-492a-a374-c40ec33663dc req-4b23e7e9-5b15-4bf8-9ebe-9f03f5ab8a17 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048959 Aug 01 15:20:34.873008 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 383/749] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:35.502810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:35.504921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:35.518631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.519279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.520211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.520798 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.650292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:35.673308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:35.738554 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:35.753205 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fce65981-7d22-4c91-8120-336e706f49ab tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1313 microversion: 2.1 time: 0.254389 Aug 01 15:20:35.773708 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:35.774460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 367/750] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:35 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:35.774596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:35.774596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.774596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.774596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.775038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.803649 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:35.817630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:35.818111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:35.818825 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lazy-loading 'fault' on Instance uuid 89484cce-c3a0-432f-98a4-a0c1da1fbf94 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:20:36.099752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.117529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.120905 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c18437883ce42369c7563224c208523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b18759847b44a698a092e4484b244d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.123048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b2971863-09ee-4d03-a9e6-6c60e8c6bbf7 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 200 len: 1370 microversion: 2.20 time: 0.373489 Aug 01 15:20:36.124273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 384/751] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:35 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 15:20:36.787458 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:36.788124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:36.795486 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:36.795943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:36.796797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:36.797245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:36.943045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:36.950940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0eacc2b4-ad49-402a-91b8-124434a7abcd tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1497 microversion: 2.1 time: 0.167412 Aug 01 15:20:36.951522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 368/752] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:36 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:37.152281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:37.153735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:37.160426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.160912 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.161699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.162135 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.177521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 HTTP/1.1 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:20:37.179426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:37.184152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '89484cce-c3a0-432f-98a4-a0c1da1fbf94'} Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:37.185139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:37.186723 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:37.188063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:37.188063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cb1c1a44-d1ca-4762-ac1c-346ee3cbf245 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 404 len: 111 microversion: 2.20 time: 0.036067 Aug 01 15:20:37.188063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 385/753] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:37 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:20:37.190505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-83127e8e-197b-4cd8-8410-2cc43c6f5351 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '.version_select at 0x7fc9dffe61f0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:37.213353 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-83127e8e-197b-4cd8-8410-2cc43c6f5351 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323573505" status: 204 len: 0 microversion: 2.20 time: 0.026760 Aug 01 15:20:37.214142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 369/754] 10.222.0.93 () {60 vars in 1259 bytes} [Mon Aug 1 15:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323573505 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 15:20:37.502052 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:37.503050 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:37.514276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.515109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.516590 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.517436 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.561074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:20:37.653689 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-30c0f6f0-7564-440a-b7e0-1653da5d3450 tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "DELETE /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 204 len: 0 microversion: 2.1 time: 0.158217 Aug 01 15:20:37.654754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 386/755] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:20:37 2022] DELETE /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:20:37.663776 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:37.664847 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:37.671540 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.672297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.673158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:37.673605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:37.857873 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:37.866554 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8851fdb9-a241-484d-83c4-940e124d12ca tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1503 microversion: 2.1 time: 0.206846 Aug 01 15:20:37.866977 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 370/756] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:37 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:38.887750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:38.888455 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:38.895037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:38.895493 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:38.896302 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:38.896789 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.032935 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:39.040516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b518665f-e5c3-4dd9-909d-224d8fac96cb tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1503 microversion: 2.1 time: 0.157475 Aug 01 15:20:39.041080 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 387/757] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:38 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:39.225026 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:39.225616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:39.232373 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.232867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.233647 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.234625 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.248728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 HTTP/1.1 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:20:39.250449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.252097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '89484cce-c3a0-432f-98a4-a0c1da1fbf94'} Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:39.252959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.254206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.256643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:39.256643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3daa7827-48d3-4bed-b853-77c34aec414e tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 404 len: 111 microversion: 2.20 time: 0.030758 Aug 01 15:20:39.256643 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 371/758] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Aug 1 15:20:39 2022] DELETE /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:20:39.260645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:39.261243 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: 89484cce-c3a0-432f-98a4-a0c1da1fbf94] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:39.268068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.268545 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.269328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.269768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.283546 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 HTTP/1.1 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:20:39.285320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.287740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '89484cce-c3a0-432f-98a4-a0c1da1fbf94'} Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:39.288750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. Aug 01 15:20:39.290165 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:39.291470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance 89484cce-c3a0-432f-98a4-a0c1da1fbf94 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:39.291470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-261460b3-c378-4902-b65a-ecf7ecc6e9da tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94" status: 404 len: 111 microversion: 2.20 time: 0.030106 Aug 01 15:20:39.291470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 388/759] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:39 2022] GET /compute/v2.1/servers/89484cce-c3a0-432f-98a4-a0c1da1fbf94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:20:39.728160 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-5f5b0d9c-68ba-45f4-a626-505a7f74f402 req-9cc58455-a40d-4862-9010-31ccdd7bad22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e4e597-acbe-4261-b788-514da81ae65a", "name": "network-vif-deleted", "tag": "40d206aa-c9fa-4f69-97ce-bb865a72b95b"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:39.738605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5f5b0d9c-68ba-45f4-a626-505a7f74f402 req-9cc58455-a40d-4862-9010-31ccdd7bad22 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:39.739096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5f5b0d9c-68ba-45f4-a626-505a7f74f402 req-9cc58455-a40d-4862-9010-31ccdd7bad22 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:39.752304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-5f5b0d9c-68ba-45f4-a626-505a7f74f402 req-9cc58455-a40d-4862-9010-31ccdd7bad22 service nova] Creating event network-vif-deleted:40d206aa-c9fa-4f69-97ce-bb865a72b95b for instance b5e4e597-acbe-4261-b788-514da81ae65a on hv-cinder-80382 Aug 01 15:20:39.757684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-5f5b0d9c-68ba-45f4-a626-505a7f74f402 req-9cc58455-a40d-4862-9010-31ccdd7bad22 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033119 Aug 01 15:20:39.758214 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 372/760] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:40.061649 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:40.062245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:40.068926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.069383 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.070166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.070607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.103693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.104141 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.104626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lazy-loading 'fault' on Instance uuid b5e4e597-acbe-4261-b788-514da81ae65a {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:20:40.152380 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aefedc120f4547e0964fb8386f9024dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1dffe73f924ee9aa7cffca0fa3d33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:40.155214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:40.162950 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fbd7b810-b8bf-4a0e-937a-ae7c2956e77d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 200 len: 1303 microversion: 2.1 time: 0.105188 Aug 01 15:20:40.163549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 389/761] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:40 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:40.430832 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:40.431431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:40.437875 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.438319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.439085 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.439573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.454525 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e HTTP/1.1 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:20:40.456198 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.457956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'f38a15b5-6333-48d9-89cc-fd29dd223d7e'} Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:40.458770 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.460153 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.461576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:40.461576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4b34e818-0cdc-49b8-a264-d76c0db6db23 tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 404 len: 111 microversion: 2.20 time: 0.031537 Aug 01 15:20:40.461576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 373/762] 10.222.0.93 () {60 vars in 1280 bytes} [Mon Aug 1 15:20:40 2022] DELETE /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:20:40.467313 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:40.468000 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] [instance: f38a15b5-6333-48d9-89cc-fd29dd223d7e] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:40.475937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.476386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.477192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:40.477628 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:40.492630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] HTTP exception thrown: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Request method failure captured: Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e HTTP/1.1 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-188PkUwp2P7VYR4mk4fIrNjmIs_0T8AbtMx_EgLx2LWUKB65FCwmUnkh3Ulq_eKpgvOyKkblMzimXPpvgbWymCIJAlS94b8cNyoavGd9edDGeuTIXSy3uohlCYglhICZ9sml-vnSw3dykESmOMoLisoeL8DGk_FCB8IQ35V3OYufY Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:20:40.494191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8b18759847b44a698a092e4484b244d0", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8b18759847b44a698a092e4484b244d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8b18759847b44a698a092e4484b244d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: 8b18759847b44a698a092e4484b244d0 Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134840868 Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 3c18437883ce42369c7563224c208523 Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134840868-project Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.495907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'f38a15b5-6333-48d9-89cc-fd29dd223d7e'} Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:40.496785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. Aug 01 15:20:40.498019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:20:40.499424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] Returning 404 to user: Instance f38a15b5-6333-48d9-89cc-fd29dd223d7e could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:40.499424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7f7f86bf-99cb-47d8-a5df-00f21867061c tempest-AttachVolumeShelveTestJSON-1134840868 tempest-AttachVolumeShelveTestJSON-1134840868-project] 10.222.0.93 "GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e" status: 404 len: 111 microversion: 2.20 time: 0.033284 Aug 01 15:20:40.499424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 390/763] 10.222.0.93 () {60 vars in 1277 bytes} [Mon Aug 1 15:20:40 2022] GET /compute/v2.1/servers/f38a15b5-6333-48d9-89cc-fd29dd223d7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:20:41.185912 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:41.186528 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] [instance: b5e4e597-acbe-4261-b788-514da81ae65a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:41.193079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:41.193616 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:41.194406 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:41.194863 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:41.209914 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] HTTP exception thrown: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Request method failure captured: Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a HTTP/1.1 Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-8lXaNajjbtq8MqgrmtzO7PF4b62W0Yuf9IYnpZtaHDlB4l8yImtDyjP6McrPGlK-2ZlokxkhTTuWdRS_NOonPplBgMwvQm1IaN1XJFE7BMplWuD2tzm1xk-uIIUNm7zZyhDwg2tt6cpga2fL52G80sY12f4-3rtgSVGJD3KW95sGQ Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 9c1dffe73f924ee9aa7cffca0fa3d33f Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:20:41.211608 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9c1dffe73f924ee9aa7cffca0fa3d33f", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9c1dffe73f924ee9aa7cffca0fa3d33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 9c1dffe73f924ee9aa7cffca0fa3d33f Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesActionsTest-1727055058 Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesActionsTest-1727055058-project Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: aefedc120f4547e0964fb8386f9024dc Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesActionsTest-1727055058-project Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. Aug 01 15:20:41.213642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'b5e4e597-acbe-4261-b788-514da81ae65a'} Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:20:41.214860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. Aug 01 15:20:41.216202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:20:41.218071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] Returning 404 to user: Instance b5e4e597-acbe-4261-b788-514da81ae65a could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:20:41.218071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f1431ada-0c70-4a74-a667-5050c388c83d tempest-VolumesActionsTest-1727055058 tempest-VolumesActionsTest-1727055058-project] 10.222.0.93 "GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a" status: 404 len: 111 microversion: 2.1 time: 0.031624 Aug 01 15:20:41.218071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 374/764] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:41 2022] GET /compute/v2.1/servers/b5e4e597-acbe-4261-b788-514da81ae65a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:20:52.414253 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:52.417987 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:52.689338 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1744fe01-9a1f-414d-97f4-c5f948596ecd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: .version_select at 0x7fc9ec716e50>, body: {"keypair": {"name": "tempest-keypair-1959935764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJwm4ZXmopUuOxO6vur2sPwPF2na/rVxB2e5OAkTa1sAj03XDC/Td58HkIgUgYM8+reugk6hmblWs89LBCJjbEO+ImpoHhALEbensExmxHb2g4fh65s/PushcXhAl+T4A=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:52.722718 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-1744fe01-9a1f-414d-97f4-c5f948596ecd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:20:52.731191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-1744fe01-9a1f-414d-97f4-c5f948596ecd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:20:52.765932 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1744fe01-9a1f-414d-97f4-c5f948596ecd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370187 Aug 01 15:20:52.767910 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 391/765] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:20:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:20:54.553004 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1620434985", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb07fa-8bcf-4e0e-8451-7a1849e093a2"}], "security_groups": [{"name": "tempest-securitygroup--204057886"}], "key_name": "tempest-keypair-1959935764", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:54.566943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:54.568107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=26 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:20:54.728998 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] validate_networks() for [('c1fb07fa-8bcf-4e0e-8451-7a1849e093a2', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:20:55.186137 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:20:55.186567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:20:55.187055 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:20:55.187484 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:20:55.187900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:20:55.206837 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.207293 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:55.208107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:55.208594 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:55.244426 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:20:55.252396 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:20:55.265829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:20:55.268566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:20:55.338951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0579ddbf-4168-4acb-b240-9a622de6a09c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.791748 Aug 01 15:20:55.343514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 375/766] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:20:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:20:55.354128 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b7b112b-d622-408c-90e2-5d92fb0d8255 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:55.357351 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8b7b112b-d622-408c-90e2-5d92fb0d8255 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:55.480583 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8b7b112b-d622-408c-90e2-5d92fb0d8255 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:55.493106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8b7b112b-d622-408c-90e2-5d92fb0d8255 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1242 microversion: 2.1 time: 0.143801 Aug 01 15:20:55.495516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 392/767] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:55 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1242 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:56.523113 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:56.525174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:56.535259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:56.536548 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:56.537709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:56.538747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:56.631112 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:56.654166 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bff4bbd6-9226-4a93-a6b3-f7f88945742a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1294 microversion: 2.1 time: 0.135529 Aug 01 15:20:56.656208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 376/768] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:56 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:20:57.682516 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:57.682956 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:57.697433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:57.698299 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:57.705064 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:57.705670 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:57.832965 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:57.849586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0f95fe9b-610a-4114-ac8f-cd4077d3c416 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1300 microversion: 2.1 time: 0.173158 Aug 01 15:20:57.851227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 393/769] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:57 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:20:58.875878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:20:58.878135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:20:58.888261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:58.889086 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:58.890059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:58.890657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:58.892470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-13f307c9-dd36-4fff-b146-80452eda46ca req-f1e7b859-3e38-41c0-9d83-d94220392214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8ca6b1-671f-4d62-9fed-492da591b712", "tag": "15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:20:58.906185 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-13f307c9-dd36-4fff-b146-80452eda46ca req-f1e7b859-3e38-41c0-9d83-d94220392214 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:20:58.906643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-13f307c9-dd36-4fff-b146-80452eda46ca req-f1e7b859-3e38-41c0-9d83-d94220392214 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:20:58.923526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-13f307c9-dd36-4fff-b146-80452eda46ca req-f1e7b859-3e38-41c0-9d83-d94220392214 service nova] Creating event network-changed:15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0 for instance 8f8ca6b1-671f-4d62-9fed-492da591b712 on hv-cinder-80382 Aug 01 15:20:58.932220 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-13f307c9-dd36-4fff-b146-80452eda46ca req-f1e7b859-3e38-41c0-9d83-d94220392214 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043265 Aug 01 15:20:58.934150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 394/770] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:20:59.186564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:20:59.196080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-539f6e88-a989-4810-9a9e-3eee8018e5d0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.327552 Aug 01 15:20:59.200154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 377/771] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:20:58 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:00.223494 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:00.225423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:00.240196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:00.241998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:00.243407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:00.244402 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:00.396867 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:00.412810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-acb76a3b-fe64-4ce8-8dcc-8b4256476372 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.194179 Aug 01 15:21:00.413400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 395/772] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:00 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:01.435773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:01.437233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:01.444476 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:01.445273 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:01.446070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:01.446510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:01.617299 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:01.626125 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1fe274e6-d28c-4ccc-a0b5-a307292287e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.195042 Aug 01 15:21:01.639816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 378/773] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:01 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:02.652070 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:02.653183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:02.664712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:02.665845 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:02.667377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:02.668668 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:02.830765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:02.838857 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5be2b6eb-03c8-499e-a978-110a42553b62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.194672 Aug 01 15:21:02.839781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 396/774] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:02 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:03.867940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:03.868932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:03.880884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:03.881513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:03.882364 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:03.882814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:04.072636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:04.083036 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8c9ab639-06ac-40a8-998c-7e00de3dac38 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.222096 Aug 01 15:21:04.084014 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 379/775] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:03 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:04.247588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-112f1081-e94d-41f5-9b0e-29dfde72f57f req-ade40025-37f2-42e0-83f4-b2241c10b892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ca6b1-671f-4d62-9fed-492da591b712", "name": "network-vif-plugged", "status": "completed", "tag": "15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:04.271010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-112f1081-e94d-41f5-9b0e-29dfde72f57f req-ade40025-37f2-42e0-83f4-b2241c10b892 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:04.271562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-112f1081-e94d-41f5-9b0e-29dfde72f57f req-ade40025-37f2-42e0-83f4-b2241c10b892 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:04.292267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-112f1081-e94d-41f5-9b0e-29dfde72f57f req-ade40025-37f2-42e0-83f4-b2241c10b892 service nova] Creating event network-vif-plugged:15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0 for instance 8f8ca6b1-671f-4d62-9fed-492da591b712 on hv-cinder-80382 Aug 01 15:21:04.305386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-112f1081-e94d-41f5-9b0e-29dfde72f57f req-ade40025-37f2-42e0-83f4-b2241c10b892 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064675 Aug 01 15:21:04.306598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 397/776] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:05.108761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:05.109493 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:05.117111 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:05.117563 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:05.118399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:05.118882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:05.222971 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:05.261110 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:05.279693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:05.288822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5271c146-32c3-41a1-bef9-5a2d499bf673 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1367 microversion: 2.1 time: 0.184735 Aug 01 15:21:05.289410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 380/777] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:05 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:06.309389 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:06.313738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:06.314433 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:06.321003 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.321454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.322228 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.322669 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.470111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:06.478074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-42cce470-208a-41d1-a93b-f4203cd7a11c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1558 microversion: 2.1 time: 0.170505 Aug 01 15:21:06.478639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 398/778] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:06 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:06.499782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:06.500321 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:06.507674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.508129 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.508955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:06.509389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:06.594866 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-00a25158-a3fd-4935-ac1e-fd6d59c77fc7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099454 Aug 01 15:21:06.595469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 381/779] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:21:06 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:07.888007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-7cb242ef-3fe8-4347-9d9c-9e503ac02ab0 req-1588f6b7-96ee-489f-ac2f-e6a2e2af359c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f8ca6b1-671f-4d62-9fed-492da591b712", "tag": "15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:07.896887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7cb242ef-3fe8-4347-9d9c-9e503ac02ab0 req-1588f6b7-96ee-489f-ac2f-e6a2e2af359c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:07.897420 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-7cb242ef-3fe8-4347-9d9c-9e503ac02ab0 req-1588f6b7-96ee-489f-ac2f-e6a2e2af359c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:07.910430 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-7cb242ef-3fe8-4347-9d9c-9e503ac02ab0 req-1588f6b7-96ee-489f-ac2f-e6a2e2af359c service nova] Creating event network-changed:15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0 for instance 8f8ca6b1-671f-4d62-9fed-492da591b712 on hv-cinder-80382 Aug 01 15:21:07.915557 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-7cb242ef-3fe8-4347-9d9c-9e503ac02ab0 req-1588f6b7-96ee-489f-ac2f-e6a2e2af359c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032874 Aug 01 15:21:07.919363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 399/780] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:22.860391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:22.862028 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=36 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:22.866377 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-154764415", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "networks": [{"uuid": "e94a4b5c-4cfa-4e5f-9982-78c7158ffa3f"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:22.920794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] validate_networks() for [('e94a4b5c-4cfa-4e5f-9982-78c7158ffa3f', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:21:23.286689 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:21:23.287118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:21:23.287597 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:21:23.288012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:21:23.288507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:21:23.298333 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:23.298782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:23.299591 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:23.300030 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:23.316951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Getting quotas for project 4fb174cae05a47ab901292a7d516f2bb. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:21:23.320745 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Getting quotas for user b6a5b96d33aa4b7a8e50fa27925f4b0d and project 4fb174cae05a47ab901292a7d516f2bb. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:21:23.332287 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:21:23.334518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:21:23.380950 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-79d2228e-95bc-4623-b978-27ca57865f7c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522572 Aug 01 15:21:23.381592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 382/781] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:21:23.391847 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:23.393063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=30 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:23.398371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0208580d-2e56-4f0c-a636-01603283fa07 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:23.399377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0208580d-2e56-4f0c-a636-01603283fa07 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:23.454207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0208580d-2e56-4f0c-a636-01603283fa07 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:23.461237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0208580d-2e56-4f0c-a636-01603283fa07 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1218 microversion: 2.1 time: 0.071609 Aug 01 15:21:23.461803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 400/782] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:23 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:24.482805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:24.483472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:24.490043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:24.490772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:24.491729 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:24.492327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:24.598684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:24.608500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b51033a5-3a43-4a03-9e58-9fcf0eecd1cd tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1288 microversion: 2.1 time: 0.128947 Aug 01 15:21:24.608500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 383/783] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:24 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:25.559185 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:25.559782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:25.567868 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.568233 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.569047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.569475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.595227 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lazy-loading 'flavor' on Instance uuid dc206caa-2b43-47a5-a386-cab848e551b4 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:21:25.628345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:25.629776 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:25.638828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.639386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.640229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.640725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.672603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7236c266-1802-41cb-84c0-eab448177fde tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "POST /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4/action" status: 202 len: 0 microversion: 2.1 time: 0.118086 Aug 01 15:21:25.673298 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 401/784] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:21:25 2022] POST /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:25.685054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:25.685754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:25.697132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.697132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.697132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.697132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.859985 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:25.870484 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-92abe9fe-a2bb-4311-b7e8-a6742d719069 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.192401 Aug 01 15:21:25.871826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 402/785] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:25 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:25.877073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-24b4e15e-5ab1-4495-b7d8-3ab35690732f req-9af3bde4-fadd-49e9-853f-640062773ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c43db4-57a1-47b1-a4f2-faed4250e5d1", "tag": "7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:25.888963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-24b4e15e-5ab1-4495-b7d8-3ab35690732f req-9af3bde4-fadd-49e9-853f-640062773ef3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:25.889738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-24b4e15e-5ab1-4495-b7d8-3ab35690732f req-9af3bde4-fadd-49e9-853f-640062773ef3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:25.893443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:25.904881 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c8a5cec2-5f55-4f1f-8308-83256f3d67a1 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.280660 Aug 01 15:21:25.905402 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-24b4e15e-5ab1-4495-b7d8-3ab35690732f req-9af3bde4-fadd-49e9-853f-640062773ef3 service nova] Creating event network-changed:7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243 for instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 on hv-cinder-80382 Aug 01 15:21:25.906083 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 384/786] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:25 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:25.910659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-24b4e15e-5ab1-4495-b7d8-3ab35690732f req-9af3bde4-fadd-49e9-853f-640062773ef3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037426 Aug 01 15:21:25.911337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 403/787] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:26.895256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:26.896036 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:26.903058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.903506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:26.904270 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.904728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:26.927539 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:26.928248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:26.935095 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.935552 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:26.936332 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:26.936803 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:27.043699 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:27.051485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-13a3d596-b98e-4fab-8d7b-644328505a84 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.160051 Aug 01 15:21:27.052109 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 385/788] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:26 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:27.078953 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:27.086280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-27c5f4c1-be55-451a-b890-90f2a9d9e557 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.163147 Aug 01 15:21:27.086828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 404/789] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:26 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:28.073016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:28.073625 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:28.080344 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:28.080818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:28.081576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:28.082016 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:28.107506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:28.108126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:28.114590 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:28.115073 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:28.115793 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:28.116223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:28.224683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:28.234414 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7e4e9c17-841e-4e8d-ab95-aebfb844643f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.165229 Aug 01 15:21:28.235093 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 386/790] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:28 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:28.255603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:28.263547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8bc518c5-e47b-4dd8-81ba-b3feab259e1d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.160810 Aug 01 15:21:28.264108 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 405/791] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:28 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:29.255161 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:29.255761 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:29.262370 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.262828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.263605 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.264043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.283510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:29.284265 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:29.291341 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.291774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.293092 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:29.293526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:29.404772 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:29.413296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e8e9b6f8-9225-4833-a612-1985033d865d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.161963 Aug 01 15:21:29.413878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 387/792] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:29 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:29.437694 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:29.445267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e6dc9124-ce2b-4329-bf09-3716b9871fbf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.165789 Aug 01 15:21:29.445884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 406/793] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:29 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:30.436188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:30.436831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:30.443418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.443862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.444650 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.445084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.465860 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:30.466479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:30.478973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.479415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.480741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:30.481191 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:30.585062 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:30.592923 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7e161368-af1a-404f-b3b9-6da984f136d4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.161164 Aug 01 15:21:30.593508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 388/794] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:30 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:30.618140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:30.626599 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3f29ef3c-7c43-4848-86cb-302e2e5535db tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.164649 Aug 01 15:21:30.627182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 407/795] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:30 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:31.614966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:31.615556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:31.622815 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.623261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.624038 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.624482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.646842 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:31.647475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:31.654017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.654544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.655312 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:31.655786 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:31.764070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:31.771678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-37433d91-2c73-4fe9-82f1-d0a84bd598b9 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.160601 Aug 01 15:21:31.772255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 389/796] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:31 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:31.792724 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:31.800469 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-281f88e2-e3e2-4d56-9af7-989d75556d89 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.157325 Aug 01 15:21:31.801117 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 408/797] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:31 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:32.336484 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:21:32.336741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:21:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:21:32.348151 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-9905e926-8ebe-4e86-ab99-38015b34f232 req-556700a5-2ddd-47d8-9261-4a3a7c28453c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c43db4-57a1-47b1-a4f2-faed4250e5d1", "name": "network-vif-plugged", "status": "completed", "tag": "7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:32.359831 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-9905e926-8ebe-4e86-ab99-38015b34f232 req-556700a5-2ddd-47d8-9261-4a3a7c28453c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.360277 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-9905e926-8ebe-4e86-ab99-38015b34f232 req-556700a5-2ddd-47d8-9261-4a3a7c28453c service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.374588 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-9905e926-8ebe-4e86-ab99-38015b34f232 req-556700a5-2ddd-47d8-9261-4a3a7c28453c service nova] Creating event network-vif-plugged:7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243 for instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 on hv-cinder-80382 Aug 01 15:21:32.379903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-9905e926-8ebe-4e86-ab99-38015b34f232 req-556700a5-2ddd-47d8-9261-4a3a7c28453c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035686 Aug 01 15:21:32.380542 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 390/798] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:21:32.793642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:32.794234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:32.800969 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.801412 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.802173 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.802607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.821892 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:32.822574 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:32.829289 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.829727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.830483 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:32.830913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:32.966011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:32.974692 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:32.975963 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-06a78c2f-f228-40aa-898d-bed148c6049f tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.186221 Aug 01 15:21:32.976606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 409/799] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:32 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:32.983224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-60f43d77-9451-4d35-a3b3-21b5cefb26ca tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.165374 Aug 01 15:21:32.983797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 391/800] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:32 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:33.999611 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:34.000300 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:34.002395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:34.003035 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:34.003654 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:34.006050 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:34.006753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:34.009462 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.010082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:34.011011 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.011926 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:34.015233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.015705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:34.016507 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:34.016957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:34.158286 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:34.159489 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:34.166342 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e181319a-7d53-4346-b43a-916c53fcc309 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1318 microversion: 2.1 time: 0.167190 Aug 01 15:21:34.166931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 392/801] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:33 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:34.168531 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-10091310-c1ab-4651-aecf-3f4045222125 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.173302 Aug 01 15:21:34.169096 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 410/802] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:33 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:35.187367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:35.188006 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:35.190105 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:35.190722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:35.194567 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:35.195015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:35.195783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:35.196217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:35.197318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:35.197768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:35.198537 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:35.199475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:35.329202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:35.336251 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:35.336731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-417cd31f-5c00-4d1d-9485-cebda10f34e5 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1507 microversion: 2.1 time: 0.153203 Aug 01 15:21:35.337314 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 393/803] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:35 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:35.344126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d33abd20-80ef-40d9-809c-bb7297b20789 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.157776 Aug 01 15:21:35.344707 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 411/804] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:35 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:36.366127 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:36.366735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:36.373984 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.374435 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.375281 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:36.375646 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:36.529783 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:36.537678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0bb7f2eb-8719-45d2-b3a0-e4af7cfdaf05 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.175323 Aug 01 15:21:36.538284 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 394/805] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:36 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:37.560378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:37.561033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:37.568306 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:37.568829 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:37.569747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:37.570284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:37.706127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:37.715606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-00cce30b-ec48-437e-982a-73a0103a2875 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.159687 Aug 01 15:21:37.716197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 412/806] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:37 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:38.737958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:38.738705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:38.745240 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.745700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:38.746461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.746893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:38.882360 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:38.891613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3d2e0300-05cc-4aa7-b5e0-cdeb255828a0 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1572 microversion: 2.1 time: 0.158003 Aug 01 15:21:38.892194 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 395/807] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:38 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:38.913303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:38.913910 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:38.925229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.925682 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:38.926561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:38.926995 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:39.020864 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117993) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 15:21:39.092217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-90945b15-ae6c-485b-ae32-8c44243d8300 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "POST /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4/action" status: 202 len: 0 microversion: 2.1 time: 0.183121 Aug 01 15:21:39.092832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 413/808] 10.222.0.93 () {60 vars in 1278 bytes} [Mon Aug 1 15:21:38 2022] POST /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:21:39.101354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:39.102058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:39.108524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:39.108985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:39.109799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:39.110237 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:39.295273 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:39.302971 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5b1b2772-8fae-4751-bb7a-460ea242ad83 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1520 microversion: 2.1 time: 0.205668 Aug 01 15:21:39.303568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 396/809] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:39 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:40.325695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:40.326321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:40.332944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:40.333403 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:40.334193 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:40.334633 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:40.480205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:40.489909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a983750f-7a88-410d-bfaa-108426427eef tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1522 microversion: 2.1 time: 0.168914 Aug 01 15:21:40.490544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 414/810] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:40 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:41.512891 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:41.513566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:41.520171 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.520649 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.521520 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:41.521958 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:41.662142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:41.670245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6d6581d0-1bc4-4ff3-93f6-0d212d7ea523 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.161823 Aug 01 15:21:41.670807 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 397/811] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:41 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:42.363551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-58a576e4-3284-4dac-88ba-c238756aa475 req-28c046dd-dd4a-4b08-ab58-7800fa6212cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "name": "network-vif-unplugged", "status": "completed", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:42.375074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-58a576e4-3284-4dac-88ba-c238756aa475 req-28c046dd-dd4a-4b08-ab58-7800fa6212cc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.375530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-58a576e4-3284-4dac-88ba-c238756aa475 req-28c046dd-dd4a-4b08-ab58-7800fa6212cc service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.379492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:42.391279 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-58a576e4-3284-4dac-88ba-c238756aa475 req-28c046dd-dd4a-4b08-ab58-7800fa6212cc service nova] Creating event network-vif-unplugged:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:21:42.396730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-58a576e4-3284-4dac-88ba-c238756aa475 req-28c046dd-dd4a-4b08-ab58-7800fa6212cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036861 Aug 01 15:21:42.397315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 415/812] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:42.691529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:42.692078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:42.698861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.699311 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.700080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:42.700543 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:42.833260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:42.841604 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-04f57d94-b8ba-40f5-b3d4-74ff6cbb322c tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.154188 Aug 01 15:21:42.842203 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 398/813] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:42 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:43.866627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:43.867345 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:43.875760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:43.876310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:43.877387 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:43.877930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:44.016716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:44.024863 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6838d014-75d5-42d7-8fca-d97fc4072ede tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.164090 Aug 01 15:21:44.025448 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 416/814] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:43 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:44.193756 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:44.194326 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:44.202012 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:44.202476 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:44.203260 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:44.203710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:44.228492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f558cb07-8fb8-4a94-baed-55c8173ae501 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/ips" status: 200 len: 151 microversion: 2.1 time: 0.038605 Aug 01 15:21:44.229152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 399/815] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:21:44 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:45.046725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:45.047336 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:45.053877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:45.054325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:45.055098 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:45.055536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:45.197939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:45.205796 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fb0b590d-18ff-4a6d-80a9-fa840bca7202 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.163458 Aug 01 15:21:45.206411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 417/816] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:45 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:45.612679 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2a7358-47fe-409a-bd66-41f96d48c18c"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:45.615023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:45.621717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:45.622162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:45.622924 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:45.623359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:45.627052 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=100 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:45.882259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8d8a0712-6589-4774-8b90-d1af373abf42 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273274 Aug 01 15:21:45.882964 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 400/817] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:21:45 2022] POST /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:46.230782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:46.231367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:46.238394 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:46.238839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:46.239608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:46.240966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:46.381336 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:46.394005 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-793b2c15-7bdf-4518-acd9-60a854c58433 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.167547 Aug 01 15:21:46.394760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 418/818] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:46 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:47.427292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:47.428046 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:47.435465 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:47.435825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:47.436619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:47.437053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:47.577692 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:47.585468 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d7cb30ed-39d4-4cda-8cf1-2fe75a1ce36a tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.162951 Aug 01 15:21:47.586040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 401/819] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:47 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:48.613307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:48.613852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:48.620765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:48.621212 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:48.621971 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:48.622404 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:48.768023 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:48.775877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-78704e45-dc7a-4a90-8501-136a25593824 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1578 microversion: 2.1 time: 0.166764 Aug 01 15:21:48.777048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 419/820] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:48 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:49.799381 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:49.799913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:49.806409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:49.806855 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:49.807609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:49.808078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:49.939979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:49.947986 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-046a4485-3bde-4c8a-8db7-938780597c7d tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1565 microversion: 2.1 time: 0.152498 Aug 01 15:21:49.949102 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 402/821] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:49 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:51.577883 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93ddfdfa-fa21-443d-b573-03cc4abb9208", "device": "/dev/sdb"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:51.580742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:51.587311 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:51.588142 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:51.588536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:51.589642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:52.068192 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c9ff03db-ac9d-4aa9-9eef-c92efe1f2264 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "POST /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494494 Aug 01 15:21:52.068778 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 420/822] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:21:51 2022] POST /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:52.506412 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-85581e27-0301-4411-84fd-2c1f8d216ea3 req-70c6a77d-0b6b-43be-84ba-8b32c3bea259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "name": "network-vif-plugged", "status": "completed", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:52.518422 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-85581e27-0301-4411-84fd-2c1f8d216ea3 req-70c6a77d-0b6b-43be-84ba-8b32c3bea259 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:52.518877 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-85581e27-0301-4411-84fd-2c1f8d216ea3 req-70c6a77d-0b6b-43be-84ba-8b32c3bea259 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:52.530337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-85581e27-0301-4411-84fd-2c1f8d216ea3 req-70c6a77d-0b6b-43be-84ba-8b32c3bea259 service nova] Creating event network-vif-plugged:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:21:52.535308 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-85581e27-0301-4411-84fd-2c1f8d216ea3 req-70c6a77d-0b6b-43be-84ba-8b32c3bea259 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Aug 01 15:21:52.535918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 403/823] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:53.442125 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b632011d-ea67-4b34-adfe-26e77549c386 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: .version_select at 0x7fc9ec716550>, body: {"keypair": {"name": "tempest-keypair-486200548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk4/NpJdrOoKDnnjXmgZLkFdqILhQPv3sUCKuS2n1SnOqWhxOZzxI/CCSBqEufQ2iX0z27lS74t+Zfiz+gbJNEwVO2XuOAY/I7FjBzv2cTmIYir3NEgByDjpzQY//nQ+A=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:53.447578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:53.460249 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b632011d-ea67-4b34-adfe-26e77549c386 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:21:53.464377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-b632011d-ea67-4b34-adfe-26e77549c386 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:21:53.487490 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b632011d-ea67-4b34-adfe-26e77549c386 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049954 Aug 01 15:21:53.488199 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 421/824] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:21:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:55.058800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2072804181", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb07fa-8bcf-4e0e-8451-7a1849e093a2"}], "security_groups": [{"name": "tempest-securitygroup--1153098334"}], "key_name": "tempest-keypair-486200548", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:55.066766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:21:55.164806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] validate_networks() for [('c1fb07fa-8bcf-4e0e-8451-7a1849e093a2', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:21:55.549455 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:21:55.549882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:21:55.550364 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:21:55.550787 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:21:55.551239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:21:55.560490 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.560947 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.561758 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:55.562197 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:55.580371 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:21:55.584413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:21:55.596100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:21:55.598505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:21:55.644819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ee0f3cf0-9a33-4094-9891-aff0daa11802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591821 Aug 01 15:21:55.645455 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 404/825] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:21:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:21:55.658170 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20206325-b2f2-48f4-a443-82d66a0794ac tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:55.659013 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-20206325-b2f2-48f4-a443-82d66a0794ac tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:55.719667 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-20206325-b2f2-48f4-a443-82d66a0794ac tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:55.726774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-20206325-b2f2-48f4-a443-82d66a0794ac tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1241 microversion: 2.1 time: 0.073254 Aug 01 15:21:55.727984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 422/826] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:55 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:56.753859 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:56.755897 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:56.765106 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.765810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.766792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:56.767398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:56.848711 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:56.858276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c00da52f-1a67-41be-9c89-88eb4bb85857 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1311 microversion: 2.1 time: 0.111112 Aug 01 15:21:56.860163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 405/827] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:56 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:21:57.881659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:57.882304 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:57.890506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.890966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:57.891751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:57.892198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.042289 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:58.050223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-eaa463b7-e58c-474d-9d8b-346ed1dbb7e7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.172396 Aug 01 15:21:58.050806 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 423/828] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:57 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:21:58.128536 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-5442c572-041c-450a-a118-0bcce7256a03 req-f7aaa8c8-32b2-404d-892e-9db6519496d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81af04ee-824a-4cb4-ad5e-56b56c9c2d5f", "tag": "db91d357-fe15-4ba6-97f9-5a5edf42aac6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:21:58.139518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5442c572-041c-450a-a118-0bcce7256a03 req-f7aaa8c8-32b2-404d-892e-9db6519496d1 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:58.140116 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5442c572-041c-450a-a118-0bcce7256a03 req-f7aaa8c8-32b2-404d-892e-9db6519496d1 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:58.152142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-5442c572-041c-450a-a118-0bcce7256a03 req-f7aaa8c8-32b2-404d-892e-9db6519496d1 service nova] Creating event network-changed:db91d357-fe15-4ba6-97f9-5a5edf42aac6 for instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f on hv-cinder-80382 Aug 01 15:21:58.157508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-5442c572-041c-450a-a118-0bcce7256a03 req-f7aaa8c8-32b2-404d-892e-9db6519496d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033003 Aug 01 15:21:58.158212 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 406/829] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:21:59.071794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:21:59.072518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:21:59.079955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.080408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.081228 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:21:59.081669 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:21:59.215150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:21:59.223207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-17c79799-a77b-405f-afd7-32ad632d19d8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.155389 Aug 01 15:21:59.223657 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 424/830] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:21:59 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:00.233939 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-550169881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846126148", "security_groups": [{"name": "tempest-secgroup-smoke-2146828685"}], "block_device_mapping_v2": [{"uuid": "91102af9-bdf7-480e-9c86-dbe5573de153", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bd69fb39-f000-4eff-9ed3-ac19740ad8e8"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:00.245533 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:00.246802 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:00.253547 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.253991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.254755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.255193 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.351662 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] validate_networks() for [('bd69fb39-f000-4eff-9ed3-ac19740ad8e8', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:22:00.392850 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:00.400752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b946ccad-0da9-4d1f-a83e-0e5017fe97b8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.159558 Aug 01 15:22:00.401377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 425/831] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:00 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:00.734763 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:22:00.735184 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:22:00.735659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:22:00.736068 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:22:00.736498 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:22:00.746099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.746543 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.747365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:00.747818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:00.765246 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:22:00.769181 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Getting quotas for user b687d38492594eab876740bdfb7db9ff and project 821ce227288a424ea530e4a7c08e41c9. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:22:00.826391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:22:00.828617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91102af9-bdf7-480e-9c86-dbe5573de153',volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:22:00.960369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-dc17c92c-7fe3-46da-8de1-34e5d2f94565 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731222 Aug 01 15:22:00.961090 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 407/832] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:22:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:22:00.972453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-35f73b25-2f96-4160-8ba3-4a11c1dccc73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:00.973245 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-35f73b25-2f96-4160-8ba3-4a11c1dccc73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:01.031810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-35f73b25-2f96-4160-8ba3-4a11c1dccc73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:01.038804 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-35f73b25-2f96-4160-8ba3-4a11c1dccc73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1094 microversion: 2.1 time: 0.070255 Aug 01 15:22:01.039375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 426/833] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:00 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:01.422637 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:01.423225 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:01.430678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.431130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.431911 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:01.432351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:01.568143 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:01.577033 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cb7a8493-deac-47cc-a761-8a74d0888d60 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.158861 Aug 01 15:22:01.577602 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 408/834] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:01 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:02.059831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:02.060387 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:02.067020 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.067466 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.068223 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.068698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.130654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:02.138219 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-68956014-67a3-4567-830e-4129860bcd27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1192 microversion: 2.1 time: 0.082857 Aug 01 15:22:02.138805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 427/835] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:02 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:02.598342 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:02.599580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:02.607115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.607558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.608337 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:02.608800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:02.816256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:02.826703 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-496c7a6e-47ff-4dc7-8af1-aabab9fd70ae tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.232546 Aug 01 15:22:02.827288 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 409/836] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:02 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:03.161156 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:03.161909 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:03.169183 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.169728 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.170622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.171132 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.344999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:03.362210 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1d20385d-78fe-476e-aaae-b2bb8640698f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.203823 Aug 01 15:22:03.362816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 428/837] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:03 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:03.489298 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-66d645dd-2f05-411c-8f10-e5943e674479 req-c2957acb-826b-4774-bc85-57c72310ba79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af04ee-824a-4cb4-ad5e-56b56c9c2d5f", "name": "network-vif-plugged", "status": "completed", "tag": "db91d357-fe15-4ba6-97f9-5a5edf42aac6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:03.500778 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-66d645dd-2f05-411c-8f10-e5943e674479 req-c2957acb-826b-4774-bc85-57c72310ba79 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.501506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-66d645dd-2f05-411c-8f10-e5943e674479 req-c2957acb-826b-4774-bc85-57c72310ba79 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.514625 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-66d645dd-2f05-411c-8f10-e5943e674479 req-c2957acb-826b-4774-bc85-57c72310ba79 service nova] Creating event network-vif-plugged:db91d357-fe15-4ba6-97f9-5a5edf42aac6 for instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f on hv-cinder-80382 Aug 01 15:22:03.519799 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-66d645dd-2f05-411c-8f10-e5943e674479 req-c2957acb-826b-4774-bc85-57c72310ba79 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034026 Aug 01 15:22:03.521190 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 410/838] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:03.764076 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-3203ea39-f65a-42af-8d02-21b2199c7fdd req-6ae5e5b3-1019-4575-8348-392015ff9aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a", "tag": "50b68dea-9370-4ad8-aa8a-527bb094c390"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:03.773841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3203ea39-f65a-42af-8d02-21b2199c7fdd req-6ae5e5b3-1019-4575-8348-392015ff9aaf service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.774289 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3203ea39-f65a-42af-8d02-21b2199c7fdd req-6ae5e5b3-1019-4575-8348-392015ff9aaf service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.786178 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-3203ea39-f65a-42af-8d02-21b2199c7fdd req-6ae5e5b3-1019-4575-8348-392015ff9aaf service nova] Creating event network-changed:50b68dea-9370-4ad8-aa8a-527bb094c390 for instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a on hv-cinder-80382 Aug 01 15:22:03.791466 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-3203ea39-f65a-42af-8d02-21b2199c7fdd req-6ae5e5b3-1019-4575-8348-392015ff9aaf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030983 Aug 01 15:22:03.792558 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 429/839] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:03.849776 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:03.850471 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:03.858698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.859251 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.860042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:03.860564 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:03.995508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:04.002853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c489cc93-e293-4256-8e7a-3a32a71daabc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.157346 Aug 01 15:22:04.003409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 411/840] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:03 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:04.384363 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:04.385081 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:04.392367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.392929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.393697 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:04.394127 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:04.528670 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:04.536226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-64809eeb-c19c-44f8-90d1-419ba0914954 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.156114 Aug 01 15:22:04.536824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 430/841] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:04 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:05.023729 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:05.024506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:05.030766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.031221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.031996 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.032447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.167792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:05.175905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-718c4f0a-f8ef-4d8c-ab4d-0d20a1bbbdd4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.156468 Aug 01 15:22:05.176542 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 412/842] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:05 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:05.557458 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:05.558189 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:05.564962 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.565419 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.566197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:05.566634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:05.707868 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:05.716246 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6ee61cfe-b35d-4108-bd42-d6bb1eb87221 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.163122 Aug 01 15:22:05.716855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 431/843] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:05 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:06.198619 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:06.199261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:06.205860 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.206315 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.207089 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.207523 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.341596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:06.349108 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ceb4ce78-c0ed-4f8d-ac79-1d560a150bc6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.155073 Aug 01 15:22:06.349672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 413/844] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:06 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:06.737446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:06.738177 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:06.745587 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.746215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.746836 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:06.747270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:06.884224 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:06.891838 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ca79dd81-f8af-4981-adbb-5533c7e0576d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.158329 Aug 01 15:22:06.892337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 432/845] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:06 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:07.370389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:07.371297 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:07.378191 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.378644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.379417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.379900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.533945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:07.541552 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-9717edaf-045c-45c8-8056-a01d3f490f54 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.175129 Aug 01 15:22:07.542148 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 414/846] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:07 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:07.912978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:07.913589 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:07.920664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.921118 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:07.921882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:07.922321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.060710 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:08.068216 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c6d5a8ec-3759-4a80-8e91-8a88b84e2af5 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.159063 Aug 01 15:22:08.068882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 433/847] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:07 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:08.562331 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:08.562960 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:08.569529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.569989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.570810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:08.571255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:08.704946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:08.712336 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c190f242-7342-4068-8c7e-2cc5d21e3161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.153910 Aug 01 15:22:08.712926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 415/848] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:08 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:09.089320 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:09.089939 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:09.096596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.097054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.097826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.098266 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.229785 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:09.233463 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:09.238721 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-88de223f-25b5-49cc-9072-e9c43fc39d73 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.153857 Aug 01 15:22:09.239298 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 434/849] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:09 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:09.734575 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:09.735259 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:09.741930 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.742385 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.743158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:09.743604 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:09.875899 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:09.883461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a1fdb011-0db6-4d6b-b472-38a7177a23e3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.153118 Aug 01 15:22:09.884061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 416/850] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:09 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:10.259781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:10.261217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:10.268851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.269295 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.270055 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.270492 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.416851 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:10.425608 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bd7f1c83-ecd5-439d-a95c-ae3c31e1cea4 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.170182 Aug 01 15:22:10.428061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 435/851] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:10 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:10.904407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:10.905042 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:10.907443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=4 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:10.913107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=12 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:10.913107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.913606 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:10.914124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:10.914558 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.046173 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:11.053752 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-617655d4-cf12-44a8-b7d8-bd4a11a0fe05 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1367 microversion: 2.1 time: 0.153187 Aug 01 15:22:11.054319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 417/852] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:10 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:11.446895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:11.447512 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:11.449508 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=8 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:11.455757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.456203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.457057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:11.457489 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:11.601698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:11.611173 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bbae54be-0324-413d-a2b6-1a1674ff3570 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.168036 Aug 01 15:22:11.611748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 436/853] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:11 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:12.075834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:12.076437 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:12.083738 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.084183 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.084988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.085414 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.223063 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:12.226809 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:12.232128 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-07b62bb9-bef8-4972-bb78-bf170b7df7c9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1557 microversion: 2.1 time: 0.160719 Aug 01 15:22:12.232747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 418/854] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:12 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:12.252996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:12.253483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:12.259807 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.260255 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.261642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.262077 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.338919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7fb11dc6-af2b-4c0d-9cf7-83f517537fe1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089776 Aug 01 15:22:12.339527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 437/855] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:22:12 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:22:12.632031 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:12.632583 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:12.639383 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.639867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.640672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:12.641115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:12.862933 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:12.870922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ac7f590e-0e90-46e4-a10e-f32034ce39ca tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.243523 Aug 01 15:22:12.871771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 419/856] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:12 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:13.376717 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-f9a19fe0-50df-4157-8f97-40d4de1bc773 req-0402c412-705f-4b28-9abd-c9eb23000f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81af04ee-824a-4cb4-ad5e-56b56c9c2d5f", "tag": "db91d357-fe15-4ba6-97f9-5a5edf42aac6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:13.386826 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f9a19fe0-50df-4157-8f97-40d4de1bc773 req-0402c412-705f-4b28-9abd-c9eb23000f2e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.387354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f9a19fe0-50df-4157-8f97-40d4de1bc773 req-0402c412-705f-4b28-9abd-c9eb23000f2e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.398841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-f9a19fe0-50df-4157-8f97-40d4de1bc773 req-0402c412-705f-4b28-9abd-c9eb23000f2e service nova] Creating event network-changed:db91d357-fe15-4ba6-97f9-5a5edf42aac6 for instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f on hv-cinder-80382 Aug 01 15:22:13.404823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-f9a19fe0-50df-4157-8f97-40d4de1bc773 req-0402c412-705f-4b28-9abd-c9eb23000f2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032196 Aug 01 15:22:13.405757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 438/857] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:13.898245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:13.899082 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:13.905684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.906208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:13.907053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:13.907552 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:14.044255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:14.052883 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f91f1016-3735-4cf4-a83d-a7348dfa57fb tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.158359 Aug 01 15:22:14.053479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 420/858] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:13 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:15.075121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:15.075834 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:15.082645 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:15.083099 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:15.083889 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:15.084330 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:15.223467 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:15.231582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7ebb8c31-bce6-4fb6-a903-a44cb5f5356a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.161214 Aug 01 15:22:15.232144 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 439/859] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:15 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:16.253417 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:16.254047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:16.262501 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.263053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.263840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:16.264335 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:16.399525 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:16.407670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-adf6e1c8-35c1-4c2d-88b1-d75a869e871d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.158939 Aug 01 15:22:16.408239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 421/860] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:16 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:17.427964 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:17.428711 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:17.436434 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:17.436953 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:17.437734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:17.438175 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:17.617990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:17.626796 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-61e4b0fe-a201-4d7b-9c94-7209ebad8e6d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.202754 Aug 01 15:22:17.627388 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 440/861] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:17 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:18.666010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:18.667475 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:18.680882 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:18.681713 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:18.683141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:18.683948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:18.840210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:18.850926 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-84f7c759-9720-4788-9912-16c6bd4e094c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.193038 Aug 01 15:22:18.851590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 422/862] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:18 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:19.117544 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:19.118157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:19.129025 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:19.129549 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:19.130406 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:19.130952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:19.235586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lazy-loading 'services' on Instance uuid 00c43db4-57a1-47b1-a4f2-faed4250e5d1 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:19.349194 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-744eadd9-1deb-4664-ae63-08d79f7c237c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "DELETE /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1/os-volume_attachments/93ddfdfa-fa21-443d-b573-03cc4abb9208" status: 202 len: 0 microversion: 2.1 time: 0.237455 Aug 01 15:22:19.350116 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 441/863] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:22:19 2022] DELETE /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1/os-volume_attachments/93ddfdfa-fa21-443d-b573-03cc4abb9208 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:22:19.876492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:19.877108 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:19.883995 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:19.884449 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:19.885885 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:19.886613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.027204 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:20.035157 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bb14df2a-f9e0-4d3b-baab-cf8e7fcadd80 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.162712 Aug 01 15:22:20.035740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 423/864] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:19 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:20.499752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:20.500332 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:20.507173 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:20.507630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.508442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:20.508883 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.535582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:22:20.627475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c8b71087-ca67-4b0c-94e2-55454c791d75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "DELETE /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 204 len: 0 microversion: 2.1 time: 0.131656 Aug 01 15:22:20.628720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 442/865] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:22:20 2022] DELETE /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:22:20.639978 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:20.640867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:20.649500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:20.649989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.651529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:20.652121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.685378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-e68b1849-58e3-4384-bb85-4503b8abab01 req-9c636a11-3eec-40fb-a724-fcdf403fd37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a", "name": "network-vif-plugged", "status": "completed", "tag": "50b68dea-9370-4ad8-aa8a-527bb094c390"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:20.697396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-e68b1849-58e3-4384-bb85-4503b8abab01 req-9c636a11-3eec-40fb-a724-fcdf403fd37b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:20.698952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-e68b1849-58e3-4384-bb85-4503b8abab01 req-9c636a11-3eec-40fb-a724-fcdf403fd37b service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:20.712483 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-e68b1849-58e3-4384-bb85-4503b8abab01 req-9c636a11-3eec-40fb-a724-fcdf403fd37b service nova] Creating event network-vif-plugged:50b68dea-9370-4ad8-aa8a-527bb094c390 for instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a on hv-cinder-80382 Aug 01 15:22:20.721721 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-e68b1849-58e3-4384-bb85-4503b8abab01 req-9c636a11-3eec-40fb-a724-fcdf403fd37b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040502 Aug 01 15:22:20.722579 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 443/866] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:22:20.822642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:20.830626 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-23ec802a-0308-4ddc-877a-5f89413d805c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1513 microversion: 2.1 time: 0.195747 Aug 01 15:22:20.831209 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 424/867] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:20 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:21.058778 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:21.059400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:21.066743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:21.067257 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:21.068124 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:21.068752 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:21.223307 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:21.232017 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-0a42c692-26b9-4424-aca9-87578a69fd04 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.178547 Aug 01 15:22:21.232612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 444/868] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:21 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:21.862055 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:21.862841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:21.870530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:21.871097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:21.872047 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:21.872746 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:22.031701 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:22.039487 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c446b722-56ef-44cd-9951-e062c0951284 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1513 microversion: 2.1 time: 0.182013 Aug 01 15:22:22.040065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 425/869] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:21 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:22.253560 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:22.254157 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:22.260865 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:22.261321 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:22.262114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:22.262542 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:22.399393 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:22.407821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-715381a8-b6c2-499d-80d6-efbbb2ca32ba tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.158709 Aug 01 15:22:22.408405 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 445/870] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:22 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:23.062229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:23.063018 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:23.070020 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:23.070593 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:23.071439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:23.072070 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:23.394856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:23.403948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-3f043c03-ca54-4dbe-b5ad-78295ea3f45d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1513 microversion: 2.1 time: 0.345744 Aug 01 15:22:23.404672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 426/871] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:23 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:23.428893 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:23.429518 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:23.436122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:23.436605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:23.437391 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:23.437832 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:23.585726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:23.594020 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-03ecfa65-cb14-4811-934f-12af856ec1ee tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1266 microversion: 2.1 time: 0.168889 Aug 01 15:22:23.594521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 446/872] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:23 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:23.706165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-32db8e5a-b43d-43ce-ab1f-6b3c1bdf71ba req-db473d63-5334-470d-b5ab-986b03596867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c43db4-57a1-47b1-a4f2-faed4250e5d1", "name": "network-vif-deleted", "tag": "7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:23.716413 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-32db8e5a-b43d-43ce-ab1f-6b3c1bdf71ba req-db473d63-5334-470d-b5ab-986b03596867 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:23.716889 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-32db8e5a-b43d-43ce-ab1f-6b3c1bdf71ba req-db473d63-5334-470d-b5ab-986b03596867 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:23.727893 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-32db8e5a-b43d-43ce-ab1f-6b3c1bdf71ba req-db473d63-5334-470d-b5ab-986b03596867 service nova] Creating event network-vif-deleted:7a05bf1a-a6e8-4f8f-9b04-057d2dc4a243 for instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 on hv-cinder-80382 Aug 01 15:22:23.732994 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-32db8e5a-b43d-43ce-ab1f-6b3c1bdf71ba req-db473d63-5334-470d-b5ab-986b03596867 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Aug 01 15:22:23.733614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 427/873] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:24.426318 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:24.426922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:24.428988 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:24.435357 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.435802 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.436841 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.437054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.470145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.470604 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.471087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lazy-loading 'fault' on Instance uuid 00c43db4-57a1-47b1-a4f2-faed4250e5d1 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:22:24.517750 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:24.525591 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d94dfec0-f3d7-4d8f-b0b0-8da455785b75 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 200 len: 1308 microversion: 2.1 time: 0.103277 Aug 01 15:22:24.526160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 447/874] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:24 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:24.618443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:24.620348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:24.627705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.628228 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.629213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.629725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.765956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:24.773917 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7b52d2e9-d620-47c6-83fb-b8fb83fce620 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1453 microversion: 2.1 time: 0.161627 Aug 01 15:22:24.774520 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 428/875] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:24 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:24.794712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:24.795329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:24.801543 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.801996 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.802771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:24.803210 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:24.938508 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:24.946211 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-32926218-fd72-4b66-89e8-d65ab34bb13d tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1453 microversion: 2.1 time: 0.155934 Aug 01 15:22:24.946792 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 448/876] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:24 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:25.547127 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:25.547748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 00c43db4-57a1-47b1-a4f2-faed4250e5d1] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:25.549873 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:25.555973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:25.556425 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:25.557735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:25.558274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:25.574141 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] HTTP exception thrown: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Request method failure captured: Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 HTTP/1.1 Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9xUDITF96bYOzjOuxqT1BjbmlztGeoPTU2tpps_3oTuu5iTiKchOXj-WN_c-8Ft_qJ4WOoS1GwH02VAEIupmgJDv7ms8CSv0PLAuGyp7WdG3SFBrElxgNu0SHiAZ8wYBDq670PW3mpqGqeZOI2dG8bvFw6JHDvDskjCrxH8vmAvMA Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 4fb174cae05a47ab901292a7d516f2bb Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:22:25.575816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4fb174cae05a47ab901292a7d516f2bb", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 4fb174cae05a47ab901292a7d516f2bb Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesSnapshotTestJSON-138091471-project Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b6a5b96d33aa4b7a8e50fa27925f4b0d Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesSnapshotTestJSON-138091471-project Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. Aug 01 15:22:25.577499 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '00c43db4-57a1-47b1-a4f2-faed4250e5d1'} Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:22:25.578367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. Aug 01 15:22:25.579771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:22:25.580967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Returning 404 to user: Instance 00c43db4-57a1-47b1-a4f2-faed4250e5d1 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:22:25.580967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6ca4ca03-da75-4852-b338-2d10538a2f85 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1" status: 404 len: 111 microversion: 2.1 time: 0.034196 Aug 01 15:22:25.580967 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 429/877] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:25 2022] GET /compute/v2.1/servers/00c43db4-57a1-47b1-a4f2-faed4250e5d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:22:26.920517 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-f022e09b-2314-4a95-a6fa-3085189faa6a req-11f77073-e733-4fb8-b50e-169ff770bfbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a", "tag": "50b68dea-9370-4ad8-aa8a-527bb094c390"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:26.931763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f022e09b-2314-4a95-a6fa-3085189faa6a req-11f77073-e733-4fb8-b50e-169ff770bfbf service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:26.932808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-f022e09b-2314-4a95-a6fa-3085189faa6a req-11f77073-e733-4fb8-b50e-169ff770bfbf service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:26.946109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-f022e09b-2314-4a95-a6fa-3085189faa6a req-11f77073-e733-4fb8-b50e-169ff770bfbf service nova] Creating event network-changed:50b68dea-9370-4ad8-aa8a-527bb094c390 for instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a on hv-cinder-80382 Aug 01 15:22:26.951619 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-f022e09b-2314-4a95-a6fa-3085189faa6a req-11f77073-e733-4fb8-b50e-169ff770bfbf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Aug 01 15:22:26.952270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 449/878] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:35.521409 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-513909596", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "networks": [{"uuid": "e94a4b5c-4cfa-4e5f-9982-78c7158ffa3f"}]}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:35.564973 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=58 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:35.578876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] validate_networks() for [('e94a4b5c-4cfa-4e5f-9982-78c7158ffa3f', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:22:35.947048 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:22:35.947983 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:22:35.948485 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:22:35.948908 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:22:35.949354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:22:35.958510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:35.958962 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:35.959765 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:35.960204 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:35.979448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Getting quotas for project 4fb174cae05a47ab901292a7d516f2bb. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:22:35.983890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Getting quotas for user b6a5b96d33aa4b7a8e50fa27925f4b0d and project 4fb174cae05a47ab901292a7d516f2bb. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:22:35.995461 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:22:35.997853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:22:36.045489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-536c7c97-7ad2-47ca-aecd-22182a2f627e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527326 Aug 01 15:22:36.046649 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 430/879] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:22:36.059477 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-184477d1-fed2-4675-b1a8-c98312e7ad99 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:36.060359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-184477d1-fed2-4675-b1a8-c98312e7ad99 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:36.117472 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-184477d1-fed2-4675-b1a8-c98312e7ad99 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:36.124955 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-184477d1-fed2-4675-b1a8-c98312e7ad99 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1218 microversion: 2.1 time: 0.070950 Aug 01 15:22:36.125542 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 450/880] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:36 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:37.147825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:37.148940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:37.156566 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:37.157023 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:37.157931 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:37.158333 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:37.277029 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:37.287586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-eff0c12d-7c63-452e-86e1-4c226086ad1e tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1278 microversion: 2.1 time: 0.144919 Aug 01 15:22:37.288189 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 431/881] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:37 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:38.310533 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:38.311098 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:38.313347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:38.321779 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:38.322217 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:38.323161 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:38.323671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:38.664237 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:38.674817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-20fc5440-ee9c-41b7-aead-029d56744f44 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.368915 Aug 01 15:22:38.676127 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-b7af3e56-1097-4f79-a893-3b054a0354be req-0c255a7d-686f-4793-8feb-babb22f96717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8", "tag": "6db78e96-d80c-4bf0-a0db-97869a72e77d"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:38.688524 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 451/882] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:38 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:22:38.692225 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b7af3e56-1097-4f79-a893-3b054a0354be req-0c255a7d-686f-4793-8feb-babb22f96717 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:38.692812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-b7af3e56-1097-4f79-a893-3b054a0354be req-0c255a7d-686f-4793-8feb-babb22f96717 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:38.706186 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-b7af3e56-1097-4f79-a893-3b054a0354be req-0c255a7d-686f-4793-8feb-babb22f96717 service nova] Creating event network-changed:6db78e96-d80c-4bf0-a0db-97869a72e77d for instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 on hv-cinder-80382 Aug 01 15:22:38.711660 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-b7af3e56-1097-4f79-a893-3b054a0354be req-0c255a7d-686f-4793-8feb-babb22f96717 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039820 Aug 01 15:22:38.712257 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 432/883] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:22:39.695434 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:39.696076 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:39.703615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.704056 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.704869 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:39.705298 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:39.841438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:39.849016 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-29cbc966-7999-40df-967d-c706ecf9350d tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.157472 Aug 01 15:22:39.849600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 452/884] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:39 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:40.871217 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:40.872115 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:40.878609 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:40.879064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:40.879856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:40.880309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:41.019230 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:41.027475 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-02b8d988-2615-4d31-b690-d4258934ae24 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.161047 Aug 01 15:22:41.028051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 433/885] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:40 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:42.048160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:42.048823 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:42.055937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:42.056386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:42.057908 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:42.058575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:42.209475 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:42.217722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9162764c-c6bd-426a-92da-4b49648def2c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.173388 Aug 01 15:22:42.218303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 453/886] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:42 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:43.240948 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:43.241691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:43.249919 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:43.250468 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:43.251271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:43.252006 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:43.399943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:43.410043 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1acbe91f-d175-4f81-979b-b911b02a5a77 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.174307 Aug 01 15:22:43.410856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 434/887] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:43 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:44.432631 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:44.433606 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:44.440077 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:44.440571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:44.441354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:44.441818 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:44.593577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:44.603734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-b2a4fb3b-c479-4051-9400-8f171ef0990c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.175814 Aug 01 15:22:44.604678 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 454/888] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:44 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:44.736069 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-3c88f742-7a00-4dd2-ab42-2295967c5273 req-b4edef45-8591-4f4d-8069-0f2aee2c4399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8", "name": "network-vif-plugged", "status": "completed", "tag": "6db78e96-d80c-4bf0-a0db-97869a72e77d"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:44.748393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-3c88f742-7a00-4dd2-ab42-2295967c5273 req-b4edef45-8591-4f4d-8069-0f2aee2c4399 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:44.749188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-3c88f742-7a00-4dd2-ab42-2295967c5273 req-b4edef45-8591-4f4d-8069-0f2aee2c4399 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:44.762508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-3c88f742-7a00-4dd2-ab42-2295967c5273 req-b4edef45-8591-4f4d-8069-0f2aee2c4399 service nova] Creating event network-vif-plugged:6db78e96-d80c-4bf0-a0db-97869a72e77d for instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 on hv-cinder-80382 Aug 01 15:22:44.769733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-3c88f742-7a00-4dd2-ab42-2295967c5273 req-b4edef45-8591-4f4d-8069-0f2aee2c4399 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Aug 01 15:22:44.770846 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 435/889] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:22:45.631526 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:45.632293 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:45.640004 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.640485 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.641354 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:45.641958 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:45.798751 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:45.812225 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-181c9de3-913c-4810-9dd5-ab6ca303a499 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1318 microversion: 2.1 time: 0.184364 Aug 01 15:22:45.813286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 455/890] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:45 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:46.833603 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:46.834460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:46.839674 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:22:46.840424 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:46.848077 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:46.848555 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:46.849456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:46.849929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:47.073122 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:22:47.083292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a006a522-febb-458d-a085-b824c03b0adf tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1507 microversion: 2.1 time: 0.251217 Aug 01 15:22:47.084065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 436/891] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:22:46 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:22:47.106476 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71ab0fa-7eb7-4cc3-9cc7-9d98943192e0", "device": "/dev/sdb"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:22:47.109207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:22:47.111425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:22:47.117202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:47.117648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:47.118435 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:22:47.118871 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:22:47.407663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d30d6a6f-f881-469d-96c9-251bf7c2d087 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "POST /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305234 Aug 01 15:22:47.408350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 456/892] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:22:47 2022] POST /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:00.617930 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.619098 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.621439 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.622179 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=30 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.627894 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.628338 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.629125 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.629556 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.653518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d6d41315-64ba-4e0b-8e1d-4c240b9b12c8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/ips" status: 200 len: 150 microversion: 2.1 time: 0.039633 Aug 01 15:23:00.654080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 437/893] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:23:00 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:00.666902 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2a7358-47fe-409a-bd66-41f96d48c18c"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:00.669465 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.672038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=23 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.672807 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:00.679546 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.679995 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.680892 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.681830 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.763021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: POST /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/os-volume_attachments HTTP/1.1 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 74 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:23:00.764805 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {"volumeAttachment": {"volumeId": "7a2a7358-47fe-409a-bd66-41f96d48c18c"}} Aug 01 15:23:00.766479 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'server_id': '81af04ee-824a-4cb4-ad5e-56b56c9c2d5f', 'body': {'volumeAttachment': {'volumeId': '7a2a7358-47fe-409a-bd66-41f96d48c18c'}}} Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:00.767478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:00.768986 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 400 to user: Invalid volume: volume 7a2a7358-47fe-409a-bd66-41f96d48c18c is already attached to instances: 8f8ca6b1-671f-4d62-9fed-492da591b712 {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cb7cf5d9-fecd-46a9-8262-d589bcad13bd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103825 Aug 01 15:23:00.770535 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 457/894] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:23:00 2022] POST /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:23:00.777867 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.778717 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.787309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.787760 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.788573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.789106 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.814229 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:00.896269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d8fb0578-ceca-4a92-be6a-7d92406a5cdf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 204 len: 0 microversion: 2.1 time: 0.124183 Aug 01 15:23:00.896900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 438/895] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:23:00 2022] DELETE /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:00.905687 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:00.906316 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:00.913280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.913731 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:00.914510 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:00.914987 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:01.048637 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:01.056282 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6c60d098-30a2-496d-a06c-cf3b412febfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1682 microversion: 2.1 time: 0.154745 Aug 01 15:23:01.057493 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 458/896] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:00 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:02.080096 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:02.080827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:02.087051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.087502 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.088271 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:02.088742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:02.220886 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:02.229818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-32b2626f-f527-483b-8e4a-2392c15beee9 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1682 microversion: 2.1 time: 0.153955 Aug 01 15:23:02.230405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 439/897] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:02 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:03.251470 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:03.252109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:03.258943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.259399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:03.260310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:03.260791 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:03.393294 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:03.401214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-d52cdc96-ca96-4de9-907a-8ed53ee7b8ee tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1682 microversion: 2.1 time: 0.153578 Aug 01 15:23:03.401780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 459/898] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:03 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:04.422884 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:04.423488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:04.430095 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.430544 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.431324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:04.431764 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:04.663508 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:04.672233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f155bc72-62df-47d9-af77-f65f49029601 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1682 microversion: 2.1 time: 0.253099 Aug 01 15:23:04.672827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 440/899] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:04 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:05.596281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6d07a796-988f-426a-bcc2-238ab02e6cc0 req-7bfffadf-1275-45ab-9f58-cae94f71870d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81af04ee-824a-4cb4-ad5e-56b56c9c2d5f", "name": "network-vif-deleted", "tag": "db91d357-fe15-4ba6-97f9-5a5edf42aac6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:05.607063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6d07a796-988f-426a-bcc2-238ab02e6cc0 req-7bfffadf-1275-45ab-9f58-cae94f71870d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.607514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6d07a796-988f-426a-bcc2-238ab02e6cc0 req-7bfffadf-1275-45ab-9f58-cae94f71870d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.619275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6d07a796-988f-426a-bcc2-238ab02e6cc0 req-7bfffadf-1275-45ab-9f58-cae94f71870d service nova] Creating event network-vif-deleted:db91d357-fe15-4ba6-97f9-5a5edf42aac6 for instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f on hv-cinder-80382 Aug 01 15:23:05.625216 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6d07a796-988f-426a-bcc2-238ab02e6cc0 req-7bfffadf-1275-45ab-9f58-cae94f71870d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Aug 01 15:23:05.625917 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 460/900] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:05.701678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:05.702302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:05.715657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.716708 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.718292 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.718825 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.765398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:05.765888 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:05.766879 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lazy-loading 'fault' on Instance uuid 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:05.817814 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:05.827531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a8675641-9431-4901-93b4-343345ed2b4f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 200 len: 1331 microversion: 2.1 time: 0.131082 Aug 01 15:23:05.828187 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 441/901] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:05 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:06.849527 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:06.850146 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:06.856899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.857386 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:06.860123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.860123 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:06.872911 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f HTTP/1.1 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:23:06.874659 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:23:06.876009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '81af04ee-824a-4cb4-ad5e-56b56c9c2d5f'} Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:06.876839 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:23:06.878284 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:06.879635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:06.879635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bc8a0a7e-3f03-4109-9ba2-412b14cbedbd tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 404 len: 111 microversion: 2.1 time: 0.031769 Aug 01 15:23:06.879635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 461/902] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:06 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:06.887319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7ce0cf1d-5108-4296-bf69-33cae7b4a818 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '.version_select at 0x7fc9dff5f5e0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:06.908821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7ce0cf1d-5108-4296-bf69-33cae7b4a818 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486200548" status: 202 len: 0 microversion: 2.1 time: 0.027206 Aug 01 15:23:06.909391 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 442/903] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Aug 1 15:23:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486200548 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:06.945122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:06.945638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:06.952766 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.953228 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:06.954010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:06.954452 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.060250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lazy-loading 'services' on Instance uuid 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:07.154709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8b2cebd9-0909-4240-82ea-76981ba07e4a tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "DELETE /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8/os-volume_attachments/d71ab0fa-7eb7-4cc3-9cc7-9d98943192e0" status: 202 len: 0 microversion: 2.1 time: 0.213350 Aug 01 15:23:07.155205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 462/904] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:23:06 2022] DELETE /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8/os-volume_attachments/d71ab0fa-7eb7-4cc3-9cc7-9d98943192e0 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:07.631139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:07.631636 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:07.639058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.639513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.640290 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.641302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.721265 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lazy-loading 'services' on Instance uuid 8f8ca6b1-671f-4d62-9fed-492da591b712 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:07.804027 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-16f8150b-1668-475a-958c-ab900444e68a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments/7a2a7358-47fe-409a-bd66-41f96d48c18c" status: 202 len: 0 microversion: 2.1 time: 0.176733 Aug 01 15:23:07.804648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 443/905] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:23:07 2022] DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments/7a2a7358-47fe-409a-bd66-41f96d48c18c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:07.813641 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:07.815990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:07.823275 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.824033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.825184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:07.825627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:07.869559 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5458860d-b030-4d91-a164-134dae899450 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060110 Aug 01 15:23:07.870221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 463/906] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:23:07 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:08.294535 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:08.295121 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:08.301495 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.301951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.302718 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.303160 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.328531 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:08.406422 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c1712f35-67ab-4b03-a69e-b88b58adadbc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "DELETE /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 204 len: 0 microversion: 2.1 time: 0.116665 Aug 01 15:23:08.406921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 444/907] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:23:08 2022] DELETE /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:08.415109 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:08.415830 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:08.422664 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.423276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.424037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.424551 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.561540 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:08.569053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8fd3ecc7-b7c0-4114-b147-9fdf9cb7b1dc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1513 microversion: 2.1 time: 0.157836 Aug 01 15:23:08.569621 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 464/908] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:08 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:08.883873 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:08.886366 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:08.892353 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.892827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.893581 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:08.894040 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:08.924319 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-99e02a05-8e93-4244-a14a-b2d1bf9d5ec4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 01 15:23:08.924818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 445/909] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:23:08 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:09.591557 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:09.592202 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:09.598810 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:09.599262 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:09.600033 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:09.600531 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:09.745968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:09.753530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5202b977-00d7-4e62-a170-85d6df413edc tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1513 microversion: 2.1 time: 0.166525 Aug 01 15:23:09.754100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 465/910] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:09 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:09.937272 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:09.939422 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:09.946050 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:09.946497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:09.947250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:09.947682 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:09.978105 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7e4df00c-f87a-46db-80d9-b1d7c2a6cfb8 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 01 15:23:09.978642 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 446/911] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:23:09 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:10.774683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:10.775286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:10.782378 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:10.782828 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:10.783607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:10.784047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:10.852347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:10.866048 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-eae758b9-879c-454d-8960-910a5e8c661c tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1471 microversion: 2.1 time: 0.095240 Aug 01 15:23:10.866904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 466/912] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:10 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1471 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:10.916806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-f1431719-33af-41e5-a941-e5b61061f7d5 req-6a974718-4324-48b9-a87e-3f6dc95836ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8", "name": "network-vif-deleted", "tag": "6db78e96-d80c-4bf0-a0db-97869a72e77d"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:10.929460 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f1431719-33af-41e5-a941-e5b61061f7d5 req-6a974718-4324-48b9-a87e-3f6dc95836ec service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:10.929829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f1431719-33af-41e5-a941-e5b61061f7d5 req-6a974718-4324-48b9-a87e-3f6dc95836ec service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:10.942125 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-f1431719-33af-41e5-a941-e5b61061f7d5 req-6a974718-4324-48b9-a87e-3f6dc95836ec service nova] Creating event network-vif-deleted:6db78e96-d80c-4bf0-a0db-97869a72e77d for instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 on hv-cinder-80382 Aug 01 15:23:10.947672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-f1431719-33af-41e5-a941-e5b61061f7d5 req-6a974718-4324-48b9-a87e-3f6dc95836ec service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034622 Aug 01 15:23:10.948311 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 447/913] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:10.990360 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:10.992630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:10.998831 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:10.999286 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.000066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.000536 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.031589 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c75a3208-a270-46b6-abc6-fcf250e8a4f3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045817 Aug 01 15:23:11.034066 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 467/914] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:23:10 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:23:11.101879 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:11.102830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:11.110275 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.110728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.111497 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.111957 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.139168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:11.229535 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c208e2bd-062c-40d0-8af2-abe93d272b0c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 204 len: 0 microversion: 2.1 time: 0.131568 Aug 01 15:23:11.230710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 448/915] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:23:11 2022] DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:11.239552 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:11.240854 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:11.246876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.247329 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.248104 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.248570 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.393920 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:11.402343 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-879213b4-7d72-4997-a57d-c97a76aa0bd0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1683 microversion: 2.1 time: 0.166340 Aug 01 15:23:11.403088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 468/916] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:11 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:11.888872 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:11.889573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:11.895731 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.896184 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.896984 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.897423 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.915644 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:11.932250 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:11.933274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:11.934024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lazy-loading 'fault' on Instance uuid 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:23:11.976586 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a5b96d33aa4b7a8e50fa27925f4b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb174cae05a47ab901292a7d516f2bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:11.984817 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-13371048-8c57-4647-be38-d4dd91e212c4 tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 200 len: 1308 microversion: 2.1 time: 0.100770 Aug 01 15:23:11.985403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 449/917] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:11 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:12.424075 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:12.424792 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:12.432159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:12.432438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:12.433197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:12.433696 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:12.570922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:12.578882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-716f7545-4f2b-4e47-9a63-4c705c455210 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1683 microversion: 2.1 time: 0.158773 Aug 01 15:23:12.579453 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 469/918] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:12 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:13.005592 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:13.006186 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] [instance: 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:13.013518 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:13.013966 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:13.014733 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:13.015166 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:13.029136 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] HTTP exception thrown: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Request method failure captured: Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 HTTP/1.1 Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9xUDITF96bYOzjOuxqT1BjbmlztGeoPTU2tpps_3oTuu5iTiKchOXj-WN_c-8Ft_qJ4WOoS1GwH02VAEIupmgJDv7ms8CSv0PLAuGyp7WdG3SFBrElxgNu0SHiAZ8wYBDq670PW3mpqGqeZOI2dG8bvFw6JHDvDskjCrxH8vmAvMA Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 4fb174cae05a47ab901292a7d516f2bb Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:23:13.030767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4fb174cae05a47ab901292a7d516f2bb", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4fb174cae05a47ab901292a7d516f2bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 4fb174cae05a47ab901292a7d516f2bb Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-138091471 Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesSnapshotTestJSON-138091471-project Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b6a5b96d33aa4b7a8e50fa27925f4b0d Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesSnapshotTestJSON-138091471-project Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. Aug 01 15:23:13.032405 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8'} Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:13.033557 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. Aug 01 15:23:13.035631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:13.036922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] Returning 404 to user: Instance 28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:13.036922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-052e0e5f-be81-4501-85ff-75852f9af96b tempest-VolumesSnapshotTestJSON-138091471 tempest-VolumesSnapshotTestJSON-138091471-project] 10.222.0.93 "GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 01 15:23:13.036922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 450/919] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:13 2022] GET /compute/v2.1/servers/28d689ff-c4c8-4d27-b2aa-4a8b5eddadc8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:13.601231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:13.601883 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:13.609811 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:13.610272 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:13.611140 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:13.611588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:13.754010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:13.761653 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4ef4cdcf-f02b-4ee7-b61a-477f77845161 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 200 len: 1683 microversion: 2.1 time: 0.164506 Aug 01 15:23:13.762229 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 470/920] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:13 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:14.087988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-f8e0325a-77bd-4f63-897d-940b0ee90e47 req-20d68120-5472-4eab-b931-e2df6b22679d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f8ca6b1-671f-4d62-9fed-492da591b712", "name": "network-vif-deleted", "tag": "15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:14.099218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f8e0325a-77bd-4f63-897d-940b0ee90e47 req-20d68120-5472-4eab-b931-e2df6b22679d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:14.099922 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-f8e0325a-77bd-4f63-897d-940b0ee90e47 req-20d68120-5472-4eab-b931-e2df6b22679d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:14.113788 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-f8e0325a-77bd-4f63-897d-940b0ee90e47 req-20d68120-5472-4eab-b931-e2df6b22679d service nova] Creating event network-vif-deleted:15e4ebb4-2ec3-4af5-97b1-7aae0e74fea0 for instance 8f8ca6b1-671f-4d62-9fed-492da591b712 on hv-cinder-80382 Aug 01 15:23:14.119099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-f8e0325a-77bd-4f63-897d-940b0ee90e47 req-20d68120-5472-4eab-b931-e2df6b22679d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 Aug 01 15:23:14.119683 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 451/921] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:14.784186 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:14.784922 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:14.791693 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:14.792148 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:14.793590 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:14.794037 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:14.808528 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 HTTP/1.1 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:23:14.810234 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:23:14.811652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '8f8ca6b1-671f-4d62-9fed-492da591b712'} Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:14.812423 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:23:14.814112 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:23:14.815278 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:14.815278 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7dc1310d-e0db-4797-a334-38e7babec26b tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 404 len: 111 microversion: 2.1 time: 0.031796 Aug 01 15:23:14.815278 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 471/922] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:14 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:23:14.821427 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e5b369f7-ba72-49de-9b2f-4be1d67f24d5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '.version_select at 0x7fc9ec08b3a0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:14.842603 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e5b369f7-ba72-49de-9b2f-4be1d67f24d5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959935764" status: 202 len: 0 microversion: 2.1 time: 0.025388 Aug 01 15:23:14.843191 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 452/923] 10.222.0.93 () {58 vars in 1221 bytes} [Mon Aug 1 15:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959935764 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:23:15.542213 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bb4dff29-ff9d-49db-a613-357033e70d97 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: .version_select at 0x7fc9ecacdb80>, body: {"keypair": {"name": "tempest-keypair-653398027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYipK/Cvx9hWvBa35Dlv17snyDtQ6yZVR3leCaUABmKkb92let9sKi1G0Zxi+1I8D1Ij4cwg7Vo+j151AGdr1WsLaal0p8OfgN6XCKfqiXz7gGwugYxJG2IaRqOhezE+A=="}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:15.559411 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-bb4dff29-ff9d-49db-a613-357033e70d97 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:15.563927 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-bb4dff29-ff9d-49db-a613-357033e70d97 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:15.594402 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bb4dff29-ff9d-49db-a613-357033e70d97 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058554 Aug 01 15:23:15.595692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 472/924] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:23:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:17.034051 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1632204260", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb07fa-8bcf-4e0e-8451-7a1849e093a2"}], "security_groups": [{"name": "tempest-securitygroup--171635527"}], "key_name": "tempest-keypair-653398027", "user_data": "}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:17.153146 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.network.neutron [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] validate_networks() for [('c1fb07fa-8bcf-4e0e-8451-7a1849e093a2', None, None, None, None, None)] {{(pid=117992) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:23:17.550268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:23:17.550740 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image limits 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:23:17.551307 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:23:17.551790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image pref 0:0:0 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:23:17.552216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.virt.hardware [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:23:17.562099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:17.562550 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:17.563359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:17.563797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:17.581983 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:23:17.586084 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:23:17.599159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Going to run 1 instances... {{(pid=117992) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:23:17.601663 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117992) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:23:17.651472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-432a0dc2-42e9-45a6-8e94-d3fef26cc3fe tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.624392 Aug 01 15:23:17.656861 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 453/925] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:23:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:23:17.664280 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fee57ba0-c064-4961-8560-29f24dc275dc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:17.666019 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fee57ba0-c064-4961-8560-29f24dc275dc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:17.732881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fee57ba0-c064-4961-8560-29f24dc275dc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:17.739937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fee57ba0-c064-4961-8560-29f24dc275dc tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1241 microversion: 2.1 time: 0.080067 Aug 01 15:23:17.740529 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 473/926] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:17 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:18.766628 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:18.767890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:18.781295 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:18.782492 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:18.784570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:18.785797 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:18.911104 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:18.924059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4a4aa3b4-dc05-4dc2-8225-fb953364f093 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1301 microversion: 2.1 time: 0.164931 Aug 01 15:23:18.936778 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 454/927] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:18 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1301 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:19.951493 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:19.952277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:19.960337 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:19.960824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:19.961648 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:19.962087 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:20.100759 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:20.109673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4534968f-e81c-4465-bcf5-c3defd88ca9c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.162444 Aug 01 15:23:20.110375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 474/928] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:19 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:20.296505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-ca25cd5f-d139-460f-b6ec-deb218f6dae5 req-7143cd34-be4c-4f1d-9967-0437c3b4a77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb7da1c-3cf0-4b8d-a567-5a01b717b579", "tag": "7d20d794-b0b1-4b69-bf92-400aa1cf77ae"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:20.311247 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-ca25cd5f-d139-460f-b6ec-deb218f6dae5 req-7143cd34-be4c-4f1d-9967-0437c3b4a77d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:20.312341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-ca25cd5f-d139-460f-b6ec-deb218f6dae5 req-7143cd34-be4c-4f1d-9967-0437c3b4a77d service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:20.341100 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-ca25cd5f-d139-460f-b6ec-deb218f6dae5 req-7143cd34-be4c-4f1d-9967-0437c3b4a77d service nova] Creating event network-changed:7d20d794-b0b1-4b69-bf92-400aa1cf77ae for instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 on hv-cinder-80382 Aug 01 15:23:20.346850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-ca25cd5f-d139-460f-b6ec-deb218f6dae5 req-7143cd34-be4c-4f1d-9967-0437c3b4a77d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054649 Aug 01 15:23:20.347903 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 455/929] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:21.132944 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:21.133765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:21.140877 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:21.141356 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:21.142244 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:21.142612 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:21.311780 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:21.326478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7c0706d7-6b4e-4d44-b36e-538bffea42f4 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.197117 Aug 01 15:23:21.327309 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 475/930] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:21 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:22.352812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:22.353529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:22.362653 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:22.363390 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.364192 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:22.364665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:22.513393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:22.521028 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-89316dd1-6717-4ddb-a5c5-8f7b5dd9102e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.175510 Aug 01 15:23:22.521607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 456/931] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:22 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:23.545371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:23.546638 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:23.553765 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.554523 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.555607 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:23.556057 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:23.695429 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:23.699736 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:23.704352 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c361f411-4450-4c9c-93ad-72b03febd481 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.164219 Aug 01 15:23:23.704966 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 476/932] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:23 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:24.725916 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:24.726553 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:24.734520 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.734975 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.735732 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:24.736166 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:24.894793 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:24.904665 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6566c340-3d8a-4406-8dc0-fad720ca95e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.182404 Aug 01 15:23:24.905675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 457/933] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:24 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:25.928047 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:25.928698 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:25.937366 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.937976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:25.938899 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:25.939464 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:26.113273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:26.122482 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c2c45894-81c2-4576-a875-4c3e6d71ebc2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.199321 Aug 01 15:23:26.123076 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 477/934] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:25 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:27.144422 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:27.145090 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:27.152252 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.152757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.153568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:27.154015 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:27.316729 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:27.327441 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0860bff3-a9a4-43e1-b3a7-a22acc2db4c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.186945 Aug 01 15:23:27.328279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 458/935] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:27 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:28.357276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:28.358781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:28.362795 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.386996 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-1cea4620-3f4e-46d1-9d4e-4546508acc45 req-8491cff2-d133-4854-8a95-6b804a7fd219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb7da1c-3cf0-4b8d-a567-5a01b717b579", "name": "network-vif-plugged", "status": "completed", "tag": "7d20d794-b0b1-4b69-bf92-400aa1cf77ae"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:28.392010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.395692 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.397448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.398221 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:28.399426 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.400039 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.423107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-1cea4620-3f4e-46d1-9d4e-4546508acc45 req-8491cff2-d133-4854-8a95-6b804a7fd219 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:28.423411 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-1cea4620-3f4e-46d1-9d4e-4546508acc45 req-8491cff2-d133-4854-8a95-6b804a7fd219 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:28.436438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-1cea4620-3f4e-46d1-9d4e-4546508acc45 req-8491cff2-d133-4854-8a95-6b804a7fd219 service nova] Creating event network-vif-plugged:7d20d794-b0b1-4b69-bf92-400aa1cf77ae for instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 on hv-cinder-80382 Aug 01 15:23:28.441737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-1cea4620-3f4e-46d1-9d4e-4546508acc45 req-8491cff2-d133-4854-8a95-6b804a7fd219 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059148 Aug 01 15:23:28.442433 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 459/936] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:28.624007 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:28.632122 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2ffa349a-3322-4a78-9b06-53e0e9caadd5 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.284587 Aug 01 15:23:28.632773 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 478/937] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:28 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:29.660964 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:29.662107 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:29.674211 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.674959 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:29.676515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:29.677304 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:30.207728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:30.215562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-779eafe5-a985-4a3f-8861-541b841f9c9f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1366 microversion: 2.1 time: 0.564071 Aug 01 15:23:30.216159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 460/938] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:29 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1366 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:31.239136 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:31.239672 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:31.242171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.247730 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:31.248174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:31.248980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:31.249468 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:31.389760 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:31.398281 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6e618b34-44c8-4b61-9936-2cc134d60070 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1556 microversion: 2.1 time: 0.163063 Aug 01 15:23:31.398817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 479/939] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:31 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:31.425532 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:31.426294 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:31.428822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:23:31.435757 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:31.436208 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:31.437075 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:31.437488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:31.547285 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-fbae7f17-352a-4a5f-ba1a-702ea38a9dfb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126582 Aug 01 15:23:31.548045 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 461/940] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:23:31 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:32.898230 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-5d0f530e-7359-4c1c-ae2a-b4a9f2094b49 req-88a83148-9e67-4cd4-b841-7a0f755236c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb7da1c-3cf0-4b8d-a567-5a01b717b579", "tag": "7d20d794-b0b1-4b69-bf92-400aa1cf77ae"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:32.910415 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5d0f530e-7359-4c1c-ae2a-b4a9f2094b49 req-88a83148-9e67-4cd4-b841-7a0f755236c6 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:32.910868 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-5d0f530e-7359-4c1c-ae2a-b4a9f2094b49 req-88a83148-9e67-4cd4-b841-7a0f755236c6 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:32.923288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-5d0f530e-7359-4c1c-ae2a-b4a9f2094b49 req-88a83148-9e67-4cd4-b841-7a0f755236c6 service nova] Creating event network-changed:7d20d794-b0b1-4b69-bf92-400aa1cf77ae for instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 on hv-cinder-80382 Aug 01 15:23:32.928454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-5d0f530e-7359-4c1c-ae2a-b4a9f2094b49 req-88a83148-9e67-4cd4-b841-7a0f755236c6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098179 Aug 01 15:23:32.929288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 480/941] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:34.721386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.722515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:34.729315 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.729915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.730706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.731144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.761342 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:23:34.870585 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ba9df059-18dc-492f-8abc-84a25b28485b tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "DELETE /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 204 len: 0 microversion: 2.1 time: 0.165378 Aug 01 15:23:34.874784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 462/942] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:23:34 2022] DELETE /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:23:34.881622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:34.882347 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:34.894773 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.895226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.896022 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.896515 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.945346 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-1b7ce2b6-24e1-4797-b59a-da033dc77fab req-e853be99-e85e-456d-bed0-c559541eb2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:34.961830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-1b7ce2b6-24e1-4797-b59a-da033dc77fab req-e853be99-e85e-456d-bed0-c559541eb2ce service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:34.962752 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-1b7ce2b6-24e1-4797-b59a-da033dc77fab req-e853be99-e85e-456d-bed0-c559541eb2ce service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:34.980965 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-1b7ce2b6-24e1-4797-b59a-da033dc77fab req-e853be99-e85e-456d-bed0-c559541eb2ce service nova] Creating event network-changed:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:23:34.989792 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-1b7ce2b6-24e1-4797-b59a-da033dc77fab req-e853be99-e85e-456d-bed0-c559541eb2ce service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049037 Aug 01 15:23:34.990878 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 463/943] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:23:35.079980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:35.088150 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4f90e69f-171d-458b-8c9d-60acf24d1bfc tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.211366 Aug 01 15:23:35.089177 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 481/944] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:34 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:36.111430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:36.112264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:36.119545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:36.120001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:36.121397 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:36.121842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:36.296167 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:36.305710 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f5e8404b-c985-495d-b71b-cb7ceccc1dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1571 microversion: 2.1 time: 0.198846 Aug 01 15:23:36.306594 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 464/945] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:36 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1571 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:23:37.341715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:37.342444 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:37.349117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:37.350584 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:37.351379 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:37.352412 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:37.411798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-59ead292-6513-4c2c-91b9-8d3c2c25dacf req-8ae73ca8-72af-4068-a52f-454b7b873cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc206caa-2b43-47a5-a386-cab848e551b4", "name": "network-vif-deleted", "tag": "30ecf5fa-45c0-441b-b03e-0238e367afa6"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:23:37.424188 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-59ead292-6513-4c2c-91b9-8d3c2c25dacf req-8ae73ca8-72af-4068-a52f-454b7b873cba service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:37.425166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-59ead292-6513-4c2c-91b9-8d3c2c25dacf req-8ae73ca8-72af-4068-a52f-454b7b873cba service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:37.429871 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31789e13f7824dae998c99eefc7aaaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbf7f1737834b12a093b137169033c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:23:37.438135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-80116de7-b2e2-414c-90d1-217dd3059da4 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 200 len: 1220 microversion: 2.1 time: 0.101216 Aug 01 15:23:37.439239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 465/946] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:37 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:23:37.443827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-59ead292-6513-4c2c-91b9-8d3c2c25dacf req-8ae73ca8-72af-4068-a52f-454b7b873cba service nova] Creating event network-vif-deleted:30ecf5fa-45c0-441b-b03e-0238e367afa6 for instance dc206caa-2b43-47a5-a386-cab848e551b4 on hv-cinder-80382 Aug 01 15:23:37.451766 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-59ead292-6513-4c2c-91b9-8d3c2c25dacf req-8ae73ca8-72af-4068-a52f-454b7b873cba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146531 Aug 01 15:23:37.452485 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 482/947] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:23:38.459500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:38.460152 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] [instance: dc206caa-2b43-47a5-a386-cab848e551b4] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:23:38.467897 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:38.468341 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:38.469150 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:23:38.469590 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:23:38.484527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] HTTP exception thrown: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Request method failure captured: Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 HTTP/1.1 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-7NP8YeWfFO4FtlvHAO95ActwEbqvLvn-O4VG9mp5Rmd46zfxha7cg0m0b8D4WkkA9XzqaVS_csSlinC7UzpP_bRDxJzGK5CjBgpuLBZthu97zKjGKGRoXlSLBKmjFKtwZCj56YLxZPDekAvivimCusWQRKGXVAnJ6TMINWBRWsdN0 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 0dbf7f1737834b12a093b137169033c5 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestShelveInstance-2054321658 Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:23:38.486255 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_0dbf7f1737834b12a093b137169033c5", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0dbf7f1737834b12a093b137169033c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/0dbf7f1737834b12a093b137169033c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/0dbf7f1737834b12a093b137169033c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestShelveInstance-2054321658 Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 0dbf7f1737834b12a093b137169033c5 Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestShelveInstance-2054321658 Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestShelveInstance-2054321658-project Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 31789e13f7824dae998c99eefc7aaaaf Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestShelveInstance-2054321658-project Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. Aug 01 15:23:38.487976 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'dc206caa-2b43-47a5-a386-cab848e551b4'} Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:23:38.489134 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. Aug 01 15:23:38.490816 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:23:38.492223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Returning 404 to user: Instance dc206caa-2b43-47a5-a386-cab848e551b4 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:23:38.492223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-c81a54ce-7492-417f-ba60-12d90d0c2dc7 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4" status: 404 len: 111 microversion: 2.1 time: 0.032171 Aug 01 15:23:38.492223 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 466/948] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:23:38 2022] GET /compute/v2.1/servers/dc206caa-2b43-47a5-a386-cab848e551b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:23:38.667876 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f159185a-9214-4531-a11e-00dfcef9d755 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] Calling method '.version_select at 0x7fc9ec945c10>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:23:38.689427 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f159185a-9214-4531-a11e-00dfcef9d755 tempest-TestShelveInstance-2054321658 tempest-TestShelveInstance-2054321658-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1645580769" status: 202 len: 0 microversion: 2.1 time: 0.026200 Aug 01 15:23:38.690467 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 483/949] 10.222.0.93 () {58 vars in 1254 bytes} [Mon Aug 1 15:23:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1645580769 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:24:09.124358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:09.125024 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:09.127263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.127923 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:09.134354 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:09.134815 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:09.135607 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:09.136049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:09.160989 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d4989b33-9b6b-4ec7-b79e-66c851ab0802 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/ips" status: 200 len: 149 microversion: 2.1 time: 0.041102 Aug 01 15:24:09.161568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 467/950] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:24:09 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:10.498054 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=28 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.498975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:10.503639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d7f413-28f8-4c8b-8905-77fe8debd929"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:10.506138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:10.515367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:10.515801 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:10.516622 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:10.517062 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:10.769937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-2fcec0cb-bd31-403f-a86d-48072486cec3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273187 Aug 01 15:24:10.770624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 484/951] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:24:10 2022] POST /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:17.678755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-8b8c8bf3-6cd8-4355-8e12-24bb2e84b683 req-20e7e6e9-7f93-4ca5-bb37-cbb03061713f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a", "tag": "50b68dea-9370-4ad8-aa8a-527bb094c390"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:17.682841 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:17.683514 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:17.691220 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:17.691938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.692779 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:17.693278 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.695772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8b8c8bf3-6cd8-4355-8e12-24bb2e84b683 req-20e7e6e9-7f93-4ca5-bb37-cbb03061713f service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:17.696396 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-8b8c8bf3-6cd8-4355-8e12-24bb2e84b683 req-20e7e6e9-7f93-4ca5-bb37-cbb03061713f service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.708273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-8b8c8bf3-6cd8-4355-8e12-24bb2e84b683 req-20e7e6e9-7f93-4ca5-bb37-cbb03061713f service nova] Creating event network-changed:50b68dea-9370-4ad8-aa8a-527bb094c390 for instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a on hv-cinder-80382 Aug 01 15:24:17.713506 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-8b8c8bf3-6cd8-4355-8e12-24bb2e84b683 req-20e7e6e9-7f93-4ca5-bb37-cbb03061713f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039128 Aug 01 15:24:17.714107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 485/952] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:17.723057 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:24:17.822359 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-33c69b45-b453-4065-83f4-9cc51ee9e52f tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "DELETE /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 204 len: 0 microversion: 2.1 time: 0.151393 Aug 01 15:24:17.823162 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 468/953] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:24:17 2022] DELETE /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:17.833221 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:17.834008 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:17.841226 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:17.841681 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.842464 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:17.842907 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:17.988735 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:17.996919 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c74b0063-3954-4d8a-93cd-6db481093c3a tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1578 microversion: 2.1 time: 0.168976 Aug 01 15:24:17.997511 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 486/954] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:17 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:18.337013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d7f413-28f8-4c8b-8905-77fe8debd929"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:18.339443 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:18.346288 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.346728 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.347502 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.347936 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.430058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: POST /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments HTTP/1.1 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 74 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:18.431777 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {"volumeAttachment": {"volumeId": "17d7f413-28f8-4c8b-8905-77fe8debd929"}} Aug 01 15:24:18.433580 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'server_id': '2cb7da1c-3cf0-4b8d-a567-5a01b717b579', 'body': {'volumeAttachment': {'volumeId': '17d7f413-28f8-4c8b-8905-77fe8debd929'}}} Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:18.434727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:18.436101 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 400 to user: Invalid volume: volume 17d7f413-28f8-4c8b-8905-77fe8debd929 is already attached to instances: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-adebc624-6186-45f0-a68b-444ba81179c0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100626 Aug 01 15:24:18.437753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 469/955] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:24:18 2022] POST /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 15:24:18.501630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:18.502447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:18.510086 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.510578 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.511461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.511904 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.597259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lazy-loading 'services' on Instance uuid 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:18.693903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-037904c1-2086-4365-b0a7-657c11e2a32e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments/17d7f413-28f8-4c8b-8905-77fe8debd929" status: 202 len: 0 microversion: 2.1 time: 0.196721 Aug 01 15:24:18.694783 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 487/956] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:24:18 2022] DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments/17d7f413-28f8-4c8b-8905-77fe8debd929 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:24:18.703453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:18.706324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:18.713529 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.713988 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.715078 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:18.715261 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:18.746929 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0404a339-f906-41db-9402-f874b61f4d11 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047962 Aug 01 15:24:18.747503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 470/957] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:24:18 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:19.020038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:19.020705 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:19.027884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.028446 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.029158 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.029626 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.194065 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:19.202305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-22f8f69d-36ca-4a4f-bdbb-5febcd441383 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1578 microversion: 2.1 time: 0.187347 Aug 01 15:24:19.202913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 488/958] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:19 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:19.759568 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:19.761659 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:19.768451 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.768969 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.769730 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:19.770174 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:19.802356 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cebeec31-2d1d-42f9-b691-60754326a3ca tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Aug 01 15:24:19.803187 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 471/959] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:24:19 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:20.225984 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:20.226978 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:20.233546 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.234042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.234777 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.235215 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.381686 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:20.389747 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-35fac019-51ea-4adb-8231-90495d731443 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1459 microversion: 2.1 time: 0.167545 Aug 01 15:24:20.390425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 489/960] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:20 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:20.628774 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-581ad13b-7a21-4901-99fd-bbfab43871bd req-e6423045-7b67-4ef4-90ad-8f9d0e823c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a", "name": "network-vif-deleted", "tag": "50b68dea-9370-4ad8-aa8a-527bb094c390"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:20.638900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-581ad13b-7a21-4901-99fd-bbfab43871bd req-e6423045-7b67-4ef4-90ad-8f9d0e823c4e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.639348 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-581ad13b-7a21-4901-99fd-bbfab43871bd req-e6423045-7b67-4ef4-90ad-8f9d0e823c4e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.652506 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-581ad13b-7a21-4901-99fd-bbfab43871bd req-e6423045-7b67-4ef4-90ad-8f9d0e823c4e service nova] Creating event network-vif-deleted:50b68dea-9370-4ad8-aa8a-527bb094c390 for instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a on hv-cinder-80382 Aug 01 15:24:20.658302 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-581ad13b-7a21-4901-99fd-bbfab43871bd req-e6423045-7b67-4ef4-90ad-8f9d0e823c4e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Aug 01 15:24:20.658941 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 472/961] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:20.814941 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:20.817174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:20.823334 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.823776 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.824564 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.824998 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.855145 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6ce91dfe-5ad4-4c33-a4c4-9fe01611e7b7 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044093 Aug 01 15:24:20.855643 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 490/962] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:24:20 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:24:20.923090 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:20.923889 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:20.931006 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.931978 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.932830 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:20.933269 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:20.967009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Going to try to terminate instance {{(pid=117992) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:24:21.059154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b41f8f06-918b-4341-8147-1e8a909ace3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 204 len: 0 microversion: 2.1 time: 0.140696 Aug 01 15:24:21.059744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 473/963] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:24:20 2022] DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:21.069399 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:21.070166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:21.076818 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:21.077375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.078031 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:21.078587 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.411771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:21.412519 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:21.418603 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:21.419053 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.419819 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:21.420249 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.429182 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:21.436990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-fa3a6a46-43ac-4915-b35f-29b2e3612c3f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1680 microversion: 2.1 time: 0.372236 Aug 01 15:24:21.437594 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 491/964] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:21 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1680 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:21.452913 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:21.453488 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:21.453808 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lazy-loading 'fault' on Instance uuid 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:21.499147 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:21.507648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bd75fa7b-e3fa-4403-8835-4208d168cdfa tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1230 microversion: 2.1 time: 0.100185 Aug 01 15:24:21.508233 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 474/965] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:21 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:22.459114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:22.459763 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:22.466542 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.466973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.467738 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.468175 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.528375 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:22.529028 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:22.535516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.535970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.536800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.537245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.568932 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:22.569386 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:22.569842 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lazy-loading 'fault' on Instance uuid 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:22.602432 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:22.610359 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-eaf0aaef-1fc3-4c5e-b065-240cfaa2611c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1680 microversion: 2.1 time: 0.155039 Aug 01 15:24:22.610942 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 492/966] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:22 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:22.611747 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:22.619156 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-85f457b4-8162-4b69-a78e-6f122e7d4dce tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 200 len: 1230 microversion: 2.1 time: 0.094629 Aug 01 15:24:22.619721 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 475/967] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:22 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:23.631121 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:23.631722 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:23.639603 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.640204 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:23.641367 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:23.641798 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.642827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.643635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.648494 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.649883 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.650886 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:23.651517 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:23.669358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] HTTP exception thrown: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Request method failure captured: Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a HTTP/1.1 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-5Jk9sQT2XDAhMeWTZlKcBevYTjluo1owQxRYb7e58Cyx1Ow-KUOq84f9prTpYWoe_UmZN5OGwRneZwxOHZfLn7KqJoJI4VfSFaMB8g2gSFMhHkeMuKa-17HfGdPM6oJrhzgsW2WCFlskIxDqfZN90ig0FXpD-TuhTQvECGZRdQi3s Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:23.671324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_821ce227288a424ea530e4a7c08e41c9", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b687d38492594eab876740bdfb7db9ff Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. Aug 01 15:24:23.672734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a'} Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:23.673530 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. Aug 01 15:24:23.674794 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:23.677526 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Returning 404 to user: Instance 42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:23.678583 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-8d7138ae-7ee8-45d1-bdeb-8d5779dd7f27 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a" status: 404 len: 111 microversion: 2.1 time: 0.042207 Aug 01 15:24:23.679351 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 476/968] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:23 2022] GET /compute/v2.1/servers/42fdfdd8-ea28-4aed-bac5-ec4e6a252a6a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:24:23.725634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:23.734430 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bd295e40-a444-47a9-b689-e35c140f3966 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1613 microversion: 2.1 time: 0.107018 Aug 01 15:24:23.746844 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 493/969] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:23 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1613 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:24.007002 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-7408b906-7db5-4c6e-951d-a617666e4660 req-265c6ef1-3429-41ca-b2a3-ef8da66c42b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb7da1c-3cf0-4b8d-a567-5a01b717b579", "name": "network-vif-deleted", "tag": "7d20d794-b0b1-4b69-bf92-400aa1cf77ae"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:24.018239 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-7408b906-7db5-4c6e-951d-a617666e4660 req-265c6ef1-3429-41ca-b2a3-ef8da66c42b9 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:24.018698 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-7408b906-7db5-4c6e-951d-a617666e4660 req-265c6ef1-3429-41ca-b2a3-ef8da66c42b9 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:24.032549 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-7408b906-7db5-4c6e-951d-a617666e4660 req-265c6ef1-3429-41ca-b2a3-ef8da66c42b9 service nova] Creating event network-vif-deleted:7d20d794-b0b1-4b69-bf92-400aa1cf77ae for instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 on hv-cinder-80382 Aug 01 15:24:24.039551 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-7408b906-7db5-4c6e-951d-a617666e4660 req-265c6ef1-3429-41ca-b2a3-ef8da66c42b9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035897 Aug 01 15:24:24.040821 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 477/970] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:24.757521 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:24.764012 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:24.771264 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:24.771846 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:24.777720 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:24.778425 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:24.818726 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:24.819368 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:24.820081 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lazy-loading 'fault' on Instance uuid 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:24:24.868285 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:24.878111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-132113a5-a2d0-4347-8825-483e12cbab25 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 200 len: 1331 microversion: 2.1 time: 0.124291 Aug 01 15:24:24.878714 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 494/971] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:24 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:25.900327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:25.901081 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:25.907404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.907862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.908672 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:25.909118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:25.922299 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 HTTP/1.1 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:25.924450 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:24:25.926274 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '2cb7da1c-3cf0-4b8d-a567-5a01b717b579'} Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:25.927276 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:24:25.928963 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:25.930477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:25.930477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b64ca123-5a2c-49e2-8a61-3a9cf0d50580 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 404 len: 111 microversion: 2.1 time: 0.030252 Aug 01 15:24:25.930477 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 478/972] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:25 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:24:25.934855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-6e528bbe-354b-4ca7-8587-61ad05696640 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '.version_select at 0x7fc9ecc4c1f0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:25.957454 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-6e528bbe-354b-4ca7-8587-61ad05696640 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653398027" status: 202 len: 0 microversion: 2.1 time: 0.025931 Aug 01 15:24:25.958634 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 495/973] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Aug 1 15:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653398027 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:24:26.792418 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6704670f-4a5f-46b5-8138-6dd4719917c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: .version_select at 0x7fc9dff46280>, body: {"keypair": {"name": "tempest-keypair-102550991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6YUpdXtZZhmg/wU6E9M4mulqolC0GhP1WW8uz0/ezJmM8iWU4843SxIR4y9BURvmm0CITFwe/z+JYI3jWjwKl1wXsndrq81v2sm4Qk9VbFXrQJpd5glT3I5EcNU6OckQ=="}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:26.808150 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-6704670f-4a5f-46b5-8138-6dd4719917c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:26.812358 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.quota [None req-6704670f-4a5f-46b5-8138-6dd4719917c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'key_pairs'} {{(pid=117992) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:26.836206 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6704670f-4a5f-46b5-8138-6dd4719917c6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047545 Aug 01 15:24:26.836767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 479/974] 10.222.0.93 () {60 vars in 1159 bytes} [Mon Aug 1 15:24:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:26.975598 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:26.977035 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:26.986636 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.987576 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:26.988845 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:26.990231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-5da8077a-b93b-429e-b961-1efdd8bd61b7 req-b5d13253-6b9e-4840-a216-73bffd6f9fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27888738-ab49-43c2-9bb9-20cf9a05b232", "tag": "26002b15-aafe-478b-b334-d773a2ef7dc7"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:26.991159 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.015158 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5da8077a-b93b-429e-b961-1efdd8bd61b7 req-b5d13253-6b9e-4840-a216-73bffd6f9fa8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.015918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-5da8077a-b93b-429e-b961-1efdd8bd61b7 req-b5d13253-6b9e-4840-a216-73bffd6f9fa8 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.028835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-5da8077a-b93b-429e-b961-1efdd8bd61b7 req-b5d13253-6b9e-4840-a216-73bffd6f9fa8 service nova] Creating event network-changed:26002b15-aafe-478b-b334-d773a2ef7dc7 for instance 27888738-ab49-43c2-9bb9-20cf9a05b232 on hv-cinder-80382 Aug 01 15:24:27.034009 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:24:27.036419 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-5da8077a-b93b-429e-b961-1efdd8bd61b7 req-b5d13253-6b9e-4840-a216-73bffd6f9fa8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054195 Aug 01 15:24:27.039324 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 480/975] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:24:27.137745 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1fa3f98a-baa5-43dd-9501-89c555629c9c tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "DELETE /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 204 len: 0 microversion: 2.1 time: 0.165737 Aug 01 15:24:27.138601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 496/976] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:24:26 2022] DELETE /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:24:27.148168 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:27.148987 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:27.157309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.157827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.159064 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:27.159810 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:27.391467 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:27.411692 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-efa44cab-4241-4e40-bca6-0e845bd310e2 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1576 microversion: 2.1 time: 0.267915 Aug 01 15:24:27.413898 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 481/977] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:27 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:28.335572 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1036145940", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1fb07fa-8bcf-4e0e-8451-7a1849e093a2"}], "security_groups": [{"name": "tempest-securitygroup--1271032772"}], "key_name": "tempest-keypair-102550991", "user_data": "}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:28.446905 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] validate_networks() for [('c1fb07fa-8bcf-4e0e-8451-7a1849e093a2', None, None, None, None, None)] {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:24:28.447309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:28.447918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:28.454650 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.455145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.455915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.456353 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.647613 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:28.655361 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d37259c7-d28e-451e-9283-c4913629c1cf tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1576 microversion: 2.1 time: 0.211868 Aug 01 15:24:28.655946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 482/978] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:28 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:28.862596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:24:28.863043 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:24:28.863519 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:24:28.863929 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:24:28.864342 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:24:28.873968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.874385 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.875387 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:28.875739 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:28.893617 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:24:28.897640 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Getting quotas for user 9673eb00ccc24fbaa495ddcbaf6d3076 and project f677d43502b044c981609fe0f0aed425. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:24:28.909371 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:24:28.911774 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:24:28.958571 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ae620a90-74b1-450b-994d-138100c9e74c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627732 Aug 01 15:24:28.959639 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 497/979] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:24:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:24:28.970169 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-30a249eb-b1af-43e5-a03a-adee24907447 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:28.972079 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-30a249eb-b1af-43e5-a03a-adee24907447 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:29.069216 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-30a249eb-b1af-43e5-a03a-adee24907447 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.076334 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-30a249eb-b1af-43e5-a03a-adee24907447 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1241 microversion: 2.1 time: 0.109891 Aug 01 15:24:29.077369 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 483/980] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:28 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:24:29.565689 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-3f2db655-b96b-49d1-b32e-5ca3871ae3cf req-5c0490ce-7abf-4d2e-b026-acc0cfc0ae02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27888738-ab49-43c2-9bb9-20cf9a05b232", "name": "network-vif-deleted", "tag": "26002b15-aafe-478b-b334-d773a2ef7dc7"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:29.578016 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3f2db655-b96b-49d1-b32e-5ca3871ae3cf req-5c0490ce-7abf-4d2e-b026-acc0cfc0ae02 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.578781 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-3f2db655-b96b-49d1-b32e-5ca3871ae3cf req-5c0490ce-7abf-4d2e-b026-acc0cfc0ae02 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.591013 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-3f2db655-b96b-49d1-b32e-5ca3871ae3cf req-5c0490ce-7abf-4d2e-b026-acc0cfc0ae02 service nova] Creating event network-vif-deleted:26002b15-aafe-478b-b334-d773a2ef7dc7 for instance 27888738-ab49-43c2-9bb9-20cf9a05b232 on hv-cinder-80382 Aug 01 15:24:29.597196 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-3f2db655-b96b-49d1-b32e-5ca3871ae3cf req-5c0490ce-7abf-4d2e-b026-acc0cfc0ae02 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036825 Aug 01 15:24:29.597866 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 498/981] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:29.678029 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:29.678727 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:29.684968 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.685421 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.686193 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:29.686657 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:29.763145 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687d38492594eab876740bdfb7db9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821ce227288a424ea530e4a7c08e41c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:29.771862 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-cbaf147b-8292-4d10-8ef4-6ecb82829bad tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 200 len: 1225 microversion: 2.1 time: 0.098528 Aug 01 15:24:29.785705 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 484/982] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:29 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:30.100106 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:30.100663 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:30.108706 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.109451 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.110233 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.110671 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.133002 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.181152 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:30.189361 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-cc114a17-cddc-4897-ab78-8251224e70ec tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1293 microversion: 2.1 time: 0.094069 Aug 01 15:24:30.189937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 499/983] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:30 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:30.795154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:30.795735 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 27888738-ab49-43c2-9bb9-20cf9a05b232] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:30.803570 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.804142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.804955 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:30.805400 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:30.810516 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:30.821505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] HTTP exception thrown: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Request method failure captured: Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 HTTP/1.1 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-5Jk9sQT2XDAhMeWTZlKcBevYTjluo1owQxRYb7e58Cyx1Ow-KUOq84f9prTpYWoe_UmZN5OGwRneZwxOHZfLn7KqJoJI4VfSFaMB8g2gSFMhHkeMuKa-17HfGdPM6oJrhzgsW2WCFlskIxDqfZN90ig0FXpD-TuhTQvECGZRdQi3s Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:30.823165 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_821ce227288a424ea530e4a7c08e41c9", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b687d38492594eab876740bdfb7db9ff Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. Aug 01 15:24:30.825013 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '27888738-ab49-43c2-9bb9-20cf9a05b232'} Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:30.826524 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. Aug 01 15:24:30.827768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:30.829503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Returning 404 to user: Instance 27888738-ab49-43c2-9bb9-20cf9a05b232 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:30.829503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-460c011c-ed0c-4b42-9f65-d94903e9c027 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232" status: 404 len: 111 microversion: 2.1 time: 0.033467 Aug 01 15:24:30.829503 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 485/984] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:30 2022] GET /compute/v2.1/servers/27888738-ab49-43c2-9bb9-20cf9a05b232 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:24:31.210447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.211081 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.220456 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.221273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.222240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.222920 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.358538 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.359393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.371766 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.372407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.373573 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.374182 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.396118 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] HTTP exception thrown: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Request method failure captured: Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 HTTP/1.1 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-5Jk9sQT2XDAhMeWTZlKcBevYTjluo1owQxRYb7e58Cyx1Ow-KUOq84f9prTpYWoe_UmZN5OGwRneZwxOHZfLn7KqJoJI4VfSFaMB8g2gSFMhHkeMuKa-17HfGdPM6oJrhzgsW2WCFlskIxDqfZN90ig0FXpD-TuhTQvECGZRdQi3s Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:31.398828 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_821ce227288a424ea530e4a7c08e41c9", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b687d38492594eab876740bdfb7db9ff Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.400571 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '7a0de715-716c-4c4b-8bef-f9be4a2ab216'} Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:31.401489 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.402952 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.406017 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Returning 404 to user: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:31.406890 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-989b9cc8-3b49-4551-ac88-a5305d9da896 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "DELETE /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 404 len: 111 microversion: 2.1 time: 0.053874 Aug 01 15:24:31.407456 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 486/985] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:24:31 2022] DELETE /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:24:31.411685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:31.416621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:31.417467 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] [instance: 7a0de715-716c-4c4b-8bef-f9be4a2ab216] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:31.421872 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a9a438aa-d085-4546-b764-f3ee30b56fad tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.215247 Aug 01 15:24:31.422979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 500/986] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:31 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:31.424800 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.425264 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.426046 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:31.426486 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:31.440902 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] HTTP exception thrown: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Request method failure captured: Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 HTTP/1.1 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-5Jk9sQT2XDAhMeWTZlKcBevYTjluo1owQxRYb7e58Cyx1Ow-KUOq84f9prTpYWoe_UmZN5OGwRneZwxOHZfLn7KqJoJI4VfSFaMB8g2gSFMhHkeMuKa-17HfGdPM6oJrhzgsW2WCFlskIxDqfZN90ig0FXpD-TuhTQvECGZRdQi3s Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:24:31.442447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_821ce227288a424ea530e4a7c08e41c9", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/821ce227288a424ea530e4a7c08e41c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 821ce227288a424ea530e4a7c08e41c9 Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-TestVolumeBootPattern-1967928852 Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: b687d38492594eab876740bdfb7db9ff Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-TestVolumeBootPattern-1967928852-project Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.444135 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '7a0de715-716c-4c4b-8bef-f9be4a2ab216'} Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:24:31.445309 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. Aug 01 15:24:31.446844 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:24:31.448510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Returning 404 to user: Instance 7a0de715-716c-4c4b-8bef-f9be4a2ab216 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:24:31.448510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-53cbe604-790b-418b-816a-e9aef6bd3366 tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216" status: 404 len: 111 microversion: 2.1 time: 0.031169 Aug 01 15:24:31.448510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 487/987] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:31 2022] GET /compute/v2.1/servers/7a0de715-716c-4c4b-8bef-f9be4a2ab216 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:24:32.075197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-a12b9d08-065d-4ede-8f17-b8d0d29ad05d req-d2b495c6-9474-41d0-b550-75f298aa48fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3c972a-1761-4af3-9e8a-ac9d486ac659", "tag": "c4e64016-7d79-422b-930f-6158616d45bf"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:32.086240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a12b9d08-065d-4ede-8f17-b8d0d29ad05d req-d2b495c6-9474-41d0-b550-75f298aa48fe service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.086688 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-a12b9d08-065d-4ede-8f17-b8d0d29ad05d req-d2b495c6-9474-41d0-b550-75f298aa48fe service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.109274 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-a12b9d08-065d-4ede-8f17-b8d0d29ad05d req-d2b495c6-9474-41d0-b550-75f298aa48fe service nova] Creating event network-changed:c4e64016-7d79-422b-930f-6158616d45bf for instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 on hv-cinder-80382 Aug 01 15:24:32.114277 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-a12b9d08-065d-4ede-8f17-b8d0d29ad05d req-d2b495c6-9474-41d0-b550-75f298aa48fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042902 Aug 01 15:24:32.114882 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 501/988] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:32.443737 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:32.444278 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:32.450626 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.451080 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.451849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:32.452290 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:32.618399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:32.627933 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-ce61753e-e887-4033-9d14-db0fa7fc0b0f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.188465 Aug 01 15:24:32.628655 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 488/989] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:32 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:32.750748 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9be34dbf-79ef-438a-aef0-c24ffbedec5e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] Calling method '.version_select at 0x7fc9ecacd040>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:32.775395 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9be34dbf-79ef-438a-aef0-c24ffbedec5e tempest-TestVolumeBootPattern-1967928852 tempest-TestVolumeBootPattern-1967928852-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846126148" status: 202 len: 0 microversion: 2.1 time: 0.029287 Aug 01 15:24:32.779654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 502/990] 10.222.0.93 () {58 vars in 1263 bytes} [Mon Aug 1 15:24:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846126148 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:24:33.649199 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:33.649805 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:33.658238 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.658981 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.659753 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:33.660473 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:33.881180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:33.889645 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-be61ef18-cba4-4797-8c04-5303279a7fb1 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.244393 Aug 01 15:24:33.890511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 489/991] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:33 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:34.911999 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:34.912915 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:34.920742 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.921270 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:34.922160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:34.922709 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:35.137424 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:35.149038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c93ae056-6cf9-4661-9c68-81099271d6da tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.241342 Aug 01 15:24:35.158582 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 503/992] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:34 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:36.173099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:36.173951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:36.183204 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.183670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.189479 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.190105 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.433270 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:36.441487 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0adf9874-3e83-4650-9231-705a68059fe2 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.274318 Aug 01 15:24:36.442176 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 490/993] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:36 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:36.873126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-09693bca-a456-4f94-b2d0-38ac49b7bd1c req-c1d80f94-2779-4082-ad52-145464dcc7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3c972a-1761-4af3-9e8a-ac9d486ac659", "name": "network-vif-plugged", "status": "completed", "tag": "c4e64016-7d79-422b-930f-6158616d45bf"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:36.882925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-09693bca-a456-4f94-b2d0-38ac49b7bd1c req-c1d80f94-2779-4082-ad52-145464dcc7c3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:36.883367 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-09693bca-a456-4f94-b2d0-38ac49b7bd1c req-c1d80f94-2779-4082-ad52-145464dcc7c3 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:36.896816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-09693bca-a456-4f94-b2d0-38ac49b7bd1c req-c1d80f94-2779-4082-ad52-145464dcc7c3 service nova] Creating event network-vif-plugged:c4e64016-7d79-422b-930f-6158616d45bf for instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 on hv-cinder-80382 Aug 01 15:24:36.902036 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-09693bca-a456-4f94-b2d0-38ac49b7bd1c req-c1d80f94-2779-4082-ad52-145464dcc7c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193755 Aug 01 15:24:36.902729 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 504/994] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:37.462806 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:37.464200 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:37.471410 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.472500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.473006 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:37.473455 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:37.722119 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:37.730246 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a297c704-aa60-41bf-9f97-de54bfcb5acf tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1367 microversion: 2.1 time: 0.271329 Aug 01 15:24:37.731030 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 491/995] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:37 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:38.753214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:38.753887 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:38.761046 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.761514 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.762325 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:38.763015 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:38.883652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.904870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:38.972954 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:24:38.989734 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dda259c5-a96b-41b9-84f2-0ea761254ed0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1557 microversion: 2.1 time: 0.241472 Aug 01 15:24:38.990772 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 505/996] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:24:38 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1557 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:24:39.014755 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:24:39.015980 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:24:39.024829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.025279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.026071 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:39.026547 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:39.073510 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=6 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:39.152905 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e77f92a9-07d5-4553-af77-d625ab81bb04 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144141 Aug 01 15:24:39.153522 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 492/997] 10.222.0.93 () {58 vars in 1275 bytes} [Mon Aug 1 15:24:39 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:24:40.555160 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-b373c397-9c32-48a5-8860-88a691cc37c2 req-c5045051-183b-4ebd-944d-c2527f5de164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3c972a-1761-4af3-9e8a-ac9d486ac659", "tag": "c4e64016-7d79-422b-930f-6158616d45bf"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:24:40.573184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:24:40.588260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b373c397-9c32-48a5-8860-88a691cc37c2 req-c5045051-183b-4ebd-944d-c2527f5de164 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:24:40.588754 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-b373c397-9c32-48a5-8860-88a691cc37c2 req-c5045051-183b-4ebd-944d-c2527f5de164 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:24:40.604130 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-b373c397-9c32-48a5-8860-88a691cc37c2 req-c5045051-183b-4ebd-944d-c2527f5de164 service nova] Creating event network-changed:c4e64016-7d79-422b-930f-6158616d45bf for instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 on hv-cinder-80382 Aug 01 15:24:40.610408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-b373c397-9c32-48a5-8860-88a691cc37c2 req-c5045051-183b-4ebd-944d-c2527f5de164 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059111 Aug 01 15:24:40.612635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 506/998] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:17.028500 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:17.029258 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=32 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:17.033631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:17.034131 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:17.042130 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.042614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.043404 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:17.043849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:17.071658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f2c2b313-8230-42e0-bbe9-d86897824856 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/ips" status: 200 len: 149 microversion: 2.1 time: 0.044475 Aug 01 15:25:17.072263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 493/999] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:25:17 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:18.460119 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eff3fce6-bf96-43a0-8414-30442c7c38a7"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:18.462642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:18.464952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=26 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:18.471438 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.472267 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.472830 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:18.473273 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:18.741913 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-965cad55-122e-4763-8cfb-9b48ef9c4462 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "POST /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286767 Aug 01 15:25:18.742601 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 507/1000] 10.222.0.93 () {60 vars in 1323 bytes} [Mon Aug 1 15:25:18 2022] POST /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:25.334600 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.335154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.342082 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.342572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.343349 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.343796 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.427059 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.objects.instance [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lazy-loading 'services' on Instance uuid 3e3c972a-1761-4af3-9e8a-ac9d486ac659 {{(pid=117992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:25:25.502466 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-69eaab1f-4642-4894-85d4-6d624624950c tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments/eff3fce6-bf96-43a0-8414-30442c7c38a7" status: 202 len: 0 microversion: 2.1 time: 0.172424 Aug 01 15:25:25.503139 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 494/1001] 10.222.0.93 () {58 vars in 1416 bytes} [Mon Aug 1 15:25:25 2022] DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments/eff3fce6-bf96-43a0-8414-30442c7c38a7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:25:25.512808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:25.515375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:25.522916 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.523400 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.524198 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:25.525276 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:25.561288 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-7dc1f115-0f1a-4cc2-b5fb-7c89703d565a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053287 Aug 01 15:25:25.561852 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 508/1002] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:25:25 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:26.574875 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.577227 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.584001 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.584457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.585241 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.585675 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.621470 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-72fec5fa-8303-4a54-900a-7e17c558001e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051171 Aug 01 15:25:26.622076 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 495/1003] 10.222.0.93 () {58 vars in 1302 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 15:25:26.687305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.687855 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.694480 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.694925 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.695712 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.696175 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.721630 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:25:26.803541 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a69478a8-447d-4ca6-a17f-a37c08c790b3 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 204 len: 0 microversion: 2.1 time: 0.119701 Aug 01 15:25:26.804128 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 509/1004] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:26 2022] DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:25:26.812282 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:26.812920 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:26.819513 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.819956 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.820744 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:26.821180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:26.961487 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:26.969345 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bf7300f4-0243-40cc-8c46-1ac17161af71 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1681 microversion: 2.1 time: 0.160874 Aug 01 15:25:26.969918 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 496/1005] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:26 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:27.991878 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:27.992525 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:27.999315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:27.999768 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.000596 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:28.001041 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:28.142205 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:28.150627 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e4411e00-c8fd-4397-b63a-55e65bb0dd62 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1681 microversion: 2.1 time: 0.163008 Aug 01 15:25:28.151214 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 510/1006] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:27 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:29.173569 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:29.174202 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:29.181472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.181920 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.182709 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.183143 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.395784 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9673eb00ccc24fbaa495ddcbaf6d3076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f677d43502b044c981609fe0f0aed425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:25:29.404876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-1fcd5d43-1715-49c0-9847-6d58695888e0 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 200 len: 1681 microversion: 2.1 time: 0.235154 Aug 01 15:25:29.420097 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 497/1007] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:29 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:29.803407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-6756e710-582c-49b0-9bf4-ebb26d251061 req-746b3318-fbc5-4c39-9cc9-0ef5e8c19b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3c972a-1761-4af3-9e8a-ac9d486ac659", "name": "network-vif-deleted", "tag": "c4e64016-7d79-422b-930f-6158616d45bf"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:29.816600 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6756e710-582c-49b0-9bf4-ebb26d251061 req-746b3318-fbc5-4c39-9cc9-0ef5e8c19b1a service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:29.817056 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-6756e710-582c-49b0-9bf4-ebb26d251061 req-746b3318-fbc5-4c39-9cc9-0ef5e8c19b1a service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:29.831725 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-6756e710-582c-49b0-9bf4-ebb26d251061 req-746b3318-fbc5-4c39-9cc9-0ef5e8c19b1a service nova] Creating event network-vif-deleted:c4e64016-7d79-422b-930f-6158616d45bf for instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 on hv-cinder-80382 Aug 01 15:25:29.840114 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-6756e710-582c-49b0-9bf4-ebb26d251061 req-746b3318-fbc5-4c39-9cc9-0ef5e8c19b1a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Aug 01 15:25:29.841082 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 511/1008] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:30.429387 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.431572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:30.439983 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.440440 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.441527 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:30.441970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:30.457472 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 HTTP/1.1 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:30.459154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:30.460979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '3e3c972a-1761-4af3-9e8a-ac9d486ac659'} Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:30.462296 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:30.463706 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:30.467630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:30.467630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b96bbfbb-9ec9-42b3-9cce-8577865d4502 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 404 len: 111 microversion: 2.1 time: 0.037249 Aug 01 15:25:30.467630 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 498/1009] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:30 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:30.474089 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-e707cad8-9635-4c03-8ee0-e78f676b923a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '.version_select at 0x7fc9ec824670>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:30.506021 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-e707cad8-9635-4c03-8ee0-e78f676b923a tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102550991" status: 202 len: 0 microversion: 2.1 time: 0.038952 Aug 01 15:25:30.510677 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 512/1010] 10.222.0.93 () {58 vars in 1218 bytes} [Mon Aug 1 15:25:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102550991 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:25:32.475055 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.476448 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.482946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.483401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.484180 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.484915 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.499224 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 HTTP/1.1 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:32.500835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.502482 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '3e3c972a-1761-4af3-9e8a-ac9d486ac659'} Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:32.503312 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.504614 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.506060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:32.506060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-296af119-d547-44c8-b03f-fc49e2bf0379 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 404 len: 111 microversion: 2.1 time: 0.031406 Aug 01 15:25:32.506060 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 499/1011] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:32 2022] DELETE /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:32.511784 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:32.512554 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 3e3c972a-1761-4af3-9e8a-ac9d486ac659] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:32.521952 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.522968 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.523755 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:32.524203 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:32.538560 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 HTTP/1.1 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:32.540248 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.541900 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '3e3c972a-1761-4af3-9e8a-ac9d486ac659'} Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:32.542843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. Aug 01 15:25:32.544250 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:32.545575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 3e3c972a-1761-4af3-9e8a-ac9d486ac659 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:32.545575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-8b5db10d-12f7-437b-9218-f2f3eed13a14 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659" status: 404 len: 111 microversion: 2.1 time: 0.034678 Aug 01 15:25:32.545575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 513/1012] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:32 2022] GET /compute/v2.1/servers/3e3c972a-1761-4af3-9e8a-ac9d486ac659 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:33.686758 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.687310 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.694166 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.694621 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.695398 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.695840 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.710056 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 HTTP/1.1 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:33.711617 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.713469 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '2cb7da1c-3cf0-4b8d-a567-5a01b717b579'} Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:33.714389 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.716009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.717596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:33.717596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-6330aa71-4e61-4220-99d9-20aab6cf3abb tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 404 len: 111 microversion: 2.1 time: 0.030124 Aug 01 15:25:33.717596 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 500/1013] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:33 2022] DELETE /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:33.721943 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.722624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 2cb7da1c-3cf0-4b8d-a567-5a01b717b579] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.730786 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.731236 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.732026 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.732678 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.748624 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 HTTP/1.1 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:33.750207 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.751843 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '2cb7da1c-3cf0-4b8d-a567-5a01b717b579'} Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:33.752816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. Aug 01 15:25:33.754408 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.755719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 2cb7da1c-3cf0-4b8d-a567-5a01b717b579 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:33.755719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ada00a0b-003a-425b-b010-70c52336016f tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579" status: 404 len: 111 microversion: 2.1 time: 0.033700 Aug 01 15:25:33.755719 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 514/1014] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/2cb7da1c-3cf0-4b8d-a567-5a01b717b579 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:33.760159 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.760736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.767172 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.767631 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.768431 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.768901 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.783445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f HTTP/1.1 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:33.785065 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.786812 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '81af04ee-824a-4cb4-ad5e-56b56c9c2d5f'} Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:33.787700 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.790009 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.791691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:33.791691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-24978c60-7c78-4b63-bf64-4d2f323ef157 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 01 15:25:33.791691 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 501/1015] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:33 2022] DELETE /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:33.795816 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:33.796442 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:33.803593 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.804586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.805377 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:33.805817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:33.820174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f HTTP/1.1 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:33.821744 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.824107 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '81af04ee-824a-4cb4-ad5e-56b56c9c2d5f'} Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:33.825053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. Aug 01 15:25:33.826556 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:33.827873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 81af04ee-824a-4cb4-ad5e-56b56c9c2d5f could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:33.827873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-1c683f31-931b-49bd-8a55-96e0631a96f6 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f" status: 404 len: 111 microversion: 2.1 time: 0.031580 Aug 01 15:25:33.827873 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 515/1016] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:33 2022] GET /compute/v2.1/servers/81af04ee-824a-4cb4-ad5e-56b56c9c2d5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:25:34.988266 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:34.989099 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:34.996438 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.996935 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:34.997742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:34.998188 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.014849 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 HTTP/1.1 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:35.016430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.018163 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '8f8ca6b1-671f-4d62-9fed-492da591b712'} Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:35.019213 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.020857 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.022562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:35.022562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-845cfee1-c9f3-403d-88f0-674bd6d80786 tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 404 len: 111 microversion: 2.1 time: 0.033729 Aug 01 15:25:35.022562 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 502/1017] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:25:34 2022] DELETE /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:35.027605 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:35.028355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] [instance: 8f8ca6b1-671f-4d62-9fed-492da591b712] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:25:35.035542 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.035990 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.036814 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:25:35.037254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:25:35.052840 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] HTTP exception thrown: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Request method failure captured: Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 HTTP/1.1 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5-9U2H0Eecm3_qzeoLwje9d9FcmMqeFAW895ciyp3AuF4_7hw1YbnZBxsm5cvrXfzfQjGyJhrzjqo5HFg-w1se_NZmA7qhuLog4md1Ku3QX9uc7g3sIqPs-sMweeyh4q5napyxmfo4QpXitM32v47BVelz171natIk6Exnf5V7xeUqI Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:35.055042 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f677d43502b044c981609fe0f0aed425", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f677d43502b044c981609fe0f0aed425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f677d43502b044c981609fe0f0aed425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f677d43502b044c981609fe0f0aed425 Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-774573487 Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: 9673eb00ccc24fbaa495ddcbaf6d3076 Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-AttachVolumeNegativeTest-774573487-project Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: > Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.057673 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': '8f8ca6b1-671f-4d62-9fed-492da591b712'} Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:35.059241 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. Aug 01 15:25:35.061757 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:35.064260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] Returning 404 to user: Instance 8f8ca6b1-671f-4d62-9fed-492da591b712 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:35.064260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c04bdfdd-46e4-4984-94f1-bd709ab0c98e tempest-AttachVolumeNegativeTest-774573487 tempest-AttachVolumeNegativeTest-774573487-project] 10.222.0.93 "GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712" status: 404 len: 111 microversion: 2.1 time: 0.032911 Aug 01 15:25:35.064260 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 516/1018] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:25:35 2022] GET /compute/v2.1/servers/8f8ca6b1-671f-4d62-9fed-492da591b712 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:25:39.989104 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-47c21b24-b295-4699-b707-dc2e07648984 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Action: 'create', calling method: .version_select at 0x7fc9dff5f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2077637524"}} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:40.358979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-47c21b24-b295-4699-b707-dc2e07648984 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.510854 Aug 01 15:25:40.359954 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 503/1019] 10.222.0.93 () {60 vars in 1155 bytes} [Mon Aug 1 15:25:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 513 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 15:25:40.377680 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-84cc7a50-13f0-42fd-b889-c60cd31cca68 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ecacd430>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:40.436973 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-84cc7a50-13f0-42fd-b889-c60cd31cca68 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 200 len: 345 microversion: 2.1 time: 0.063872 Aug 01 15:25:40.437562 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 517/1020] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:40 2022] GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:41.454633 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-bdce2934-bc9e-4e86-b67b-5268c0c12ae6 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dffbee50>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.514395 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-bdce2934-bc9e-4e86-b67b-5268c0c12ae6 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 200 len: 346 microversion: 2.1 time: 0.064117 Aug 01 15:25:41.514979 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 504/1021] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:41.530937 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bc3d891a-8363-4da3-9011-6db396355d4f tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Action: 'create', calling method: .version_select at 0x7fc9ec7160d0>, body: {"snapshot": {"volume_id": "ad3c00b4-1527-40e4-92ec-7be9d0f5e014", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2094184172"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:25:41.710534 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bc3d891a-8363-4da3-9011-6db396355d4f tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.186549 Aug 01 15:25:41.711240 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 518/1022] 10.222.0.93 () {60 vars in 1162 bytes} [Mon Aug 1 15:25:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:41.724061 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-784966f8-7efc-4d9d-bdf6-e9f1b981473a tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dfedd310>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.760748 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-784966f8-7efc-4d9d-bdf6-e9f1b981473a tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 287 microversion: 2.1 time: 0.040583 Aug 01 15:25:41.761401 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 505/1023] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:41.773370 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-32f4282b-b22c-4bc0-817f-6fbe0a1b1c2f tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ecacd670>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.811232 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-32f4282b-b22c-4bc0-817f-6fbe0a1b1c2f tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041580 Aug 01 15:25:41.812171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 519/1024] 10.222.0.93 () {58 vars in 1140 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:41.828511 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-370a2b01-726e-4fd5-9944-e00cbbcf344e tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dff5f280>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:41.863091 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-370a2b01-726e-4fd5-9944-e00cbbcf344e tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 287 microversion: 2.1 time: 0.038125 Aug 01 15:25:41.864138 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 506/1025] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:41 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:42.878131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-3f783cb1-10d4-49f5-a7ea-aed1ad695f6a tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ecc4cee0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:42.911522 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-3f783cb1-10d4-49f5-a7ea-aed1ad695f6a tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 287 microversion: 2.1 time: 0.037678 Aug 01 15:25:42.912100 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 520/1026] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:42 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 15:25:43.925085 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-73f67e17-be7b-4854-91f3-b96d0d9f647b tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dfee2430>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:43.958246 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-73f67e17-be7b-4854-91f3-b96d0d9f647b tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 287 microversion: 2.1 time: 0.037542 Aug 01 15:25:43.958827 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 507/1027] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:43 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:44.971997 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-ef856778-0631-4416-a1a6-31b3ef726e9e tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ec681ee0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.002895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-ef856778-0631-4416-a1a6-31b3ef726e9e tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 288 microversion: 2.1 time: 0.035304 Aug 01 15:25:45.003478 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 521/1028] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:44 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:45.012938 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_api:SELECT=20 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.013703 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.018620 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-e266f8d7-692e-4c11-8140-d2577fd8c703 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dfee24c0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.085868 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-e266f8d7-692e-4c11-8140-d2577fd8c703 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 202 len: 0 microversion: 2.1 time: 0.074213 Aug 01 15:25:45.086505 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 508/1029] 10.222.0.93 () {58 vars in 1254 bytes} [Mon Aug 1 15:25:45 2022] DELETE /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 15:25:45.092074 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.093005 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:25:45.097782 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-9fe2c28c-fc78-4ca2-a5ff-6060cd9a0344 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ecc4c4c0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:45.132298 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-9fe2c28c-fc78-4ca2-a5ff-6060cd9a0344 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 200 len: 287 microversion: 2.1 time: 0.041036 Aug 01 15:25:45.132980 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 522/1030] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:45 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:46.145625 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-136cfa19-9ad4-4b2a-8727-bc8c34d7c363 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ec0678b0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.172154 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-136cfa19-9ad4-4b2a-8727-bc8c34d7c363 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] HTTP exception thrown: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-136cfa19-9ad4-4b2a-8727-bc8c34d7c363 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Request method failure captured: Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 HTTP/1.1 Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5_Bz_OtQ7bKqaAlawm2EmezscIh119onYH3vKGTR1IkAPzgBoyvmCi53OniUuJBuRDSk2Sr-Mbt4P7U-hoQoJ6kq9FGD7styNq5t4TjPZjsdK_1uJkQhm2qYdxc8fkiZvklAOWi2fG6X1w-vONONZXKsJq6VWExI0HFrHhttT04dm4I Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:46.174434 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8c88d6d3b984e55a67453b186d219ec", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: f9a7719ad9f944438717aba8c74047ba Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '60175a9e-4232-4aaa-b95d-34017aa5a652'} Aug 01 15:25:46.175940 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. (HTTP 404) (Request-ID: req-13b167b2-514e-4a94-84c3-55c387c97117) Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.176853 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:46.178416 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 15:25:46.179742 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-136cfa19-9ad4-4b2a-8727-bc8c34d7c363 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Returning 404 to user: Snapshot 60175a9e-4232-4aaa-b95d-34017aa5a652 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:46.181399 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-136cfa19-9ad4-4b2a-8727-bc8c34d7c363 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652" status: 404 len: 111 microversion: 2.1 time: 0.034738 Aug 01 15:25:46.182447 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 509/1031] 10.222.0.93 () {58 vars in 1251 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/os-snapshots/60175a9e-4232-4aaa-b95d-34017aa5a652 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:46.185808 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-bec11c22-a1f9-441c-a71e-7ec1899b281d tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ec836b80>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.255856 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-bec11c22-a1f9-441c-a71e-7ec1899b281d tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 202 len: 0 microversion: 2.1 time: 0.074305 Aug 01 15:25:46.257254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 523/1032] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:25:46 2022] DELETE /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 15:25:46.266393 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-17a7f168-c98a-4f73-b99a-0876332f0f82 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dffbe0d0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:46.317044 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-17a7f168-c98a-4f73-b99a-0876332f0f82 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 200 len: 345 microversion: 2.1 time: 0.055053 Aug 01 15:25:46.317601 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 510/1033] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:46 2022] GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:47.331905 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f10b1da8-fe79-4a22-be4d-7c091564e0b9 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ecacdf70>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.361407 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-f10b1da8-fe79-4a22-be4d-7c091564e0b9 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] HTTP exception thrown: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f10b1da8-fe79-4a22-be4d-7c091564e0b9 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Request method failure captured: Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 HTTP/1.1 Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5_Bz_OtQ7bKqaAlawm2EmezscIh119onYH3vKGTR1IkAPzgBoyvmCi53OniUuJBuRDSk2Sr-Mbt4P7U-hoQoJ6kq9FGD7styNq5t4TjPZjsdK_1uJkQhm2qYdxc8fkiZvklAOWi2fG6X1w-vONONZXKsJq6VWExI0HFrHhttT04dm4I Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:47.363382 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8c88d6d3b984e55a67453b186d219ec", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: f9a7719ad9f944438717aba8c74047ba Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'ad3c00b4-1527-40e4-92ec-7be9d0f5e014'} Aug 01 15:25:47.365138 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. (HTTP 404) (Request-ID: req-e3d54665-3035-4ee9-81e5-4a32af87286c) Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.366930 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:47.368561 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:25:47.370586 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f10b1da8-fe79-4a22-be4d-7c091564e0b9 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Returning 404 to user: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f10b1da8-fe79-4a22-be4d-7c091564e0b9 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 404 len: 109 microversion: 2.1 time: 0.037232 Aug 01 15:25:47.372660 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 524/1034] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:47 2022] GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:25:47.376338 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5bc14897-d200-422c-bbbf-80a26965037c tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9dff5fd30>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.407195 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-5bc14897-d200-422c-bbbf-80a26965037c tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] HTTP exception thrown: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5bc14897-d200-422c-bbbf-80a26965037c tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Request method failure captured: Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: DELETE /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 HTTP/1.1 Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5_Bz_OtQ7bKqaAlawm2EmezscIh119onYH3vKGTR1IkAPzgBoyvmCi53OniUuJBuRDSk2Sr-Mbt4P7U-hoQoJ6kq9FGD7styNq5t4TjPZjsdK_1uJkQhm2qYdxc8fkiZvklAOWi2fG6X1w-vONONZXKsJq6VWExI0HFrHhttT04dm4I Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:25:47.409256 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8c88d6d3b984e55a67453b186d219ec", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: f9a7719ad9f944438717aba8c74047ba Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': 'ad3c00b4-1527-40e4-92ec-7be9d0f5e014'} Aug 01 15:25:47.413627 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. (HTTP 404) (Request-ID: req-b4b222c7-8d30-4c8a-a3f7-7b193fb25336) Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.415612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 15:25:47.417790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 15:25:47.419876 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-5bc14897-d200-422c-bbbf-80a26965037c tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Returning 404 to user: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:47.421767 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-5bc14897-d200-422c-bbbf-80a26965037c tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 404 len: 109 microversion: 2.1 time: 0.038966 Aug 01 15:25:47.422782 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 511/1035] 10.222.0.93 () {58 vars in 1248 bytes} [Mon Aug 1 15:25:47 2022] DELETE /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:25:47.422881 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a9edffc5-5897-4274-a2f7-974eaeae3a36 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Calling method '.version_select at 0x7fc9ec836b80>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:47.451346 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.wsgi [None req-a9edffc5-5897-4274-a2f7-974eaeae3a36 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] HTTP exception thrown: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a9edffc5-5897-4274-a2f7-974eaeae3a36 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Request method failure captured: Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: request: GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 HTTP/1.1 Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept: application/json Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Accept-Encoding: identity Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Connection: close Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Length: 0 Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Content-Type: application/json Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Host: 10.222.0.93 Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Openstack-System-Scope: None Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: User-Agent: python-urllib3/1.26.10 Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Auth-Token: gAAAAABi5_Bz_OtQ7bKqaAlawm2EmezscIh119onYH3vKGTR1IkAPzgBoyvmCi53OniUuJBuRDSk2Sr-Mbt4P7U-hoQoJ6kq9FGD7styNq5t4TjPZjsdK_1uJkQhm2qYdxc8fkiZvklAOWi2fG6X1w-vONONZXKsJq6VWExI0HFrHhttT04dm4I Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Id: None Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Domain-Name: None Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Identity-Status: Confirmed Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Is-Admin-Project: True Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Id: default Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Domain-Name: Default Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Role: member,reader Aug 01 15:25:47.451695 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Roles: member,reader Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_f8c88d6d3b984e55a67453b186d219ec", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/f8c88d6d3b984e55a67453b186d219ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Id: f8c88d6d3b984e55a67453b186d219ec Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1229944336 Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Id: default Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Domain-Name: Default Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Id: f9a7719ad9f944438717aba8c74047ba Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1229944336-project Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: method: Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: exception: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: action_args: {'id': 'ad3c00b4-1527-40e4-92ec-7be9d0f5e014'} Aug 01 15:25:47.460450 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. (HTTP 404) (Request-ID: req-aebf6c17-17c7-40cc-85e9-486ef7c60c77) Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.462151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 15:25:47.463568 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 15:25:47.465231 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR nova.api.openstack.wsgi Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-a9edffc5-5897-4274-a2f7-974eaeae3a36 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] Returning 404 to user: Volume ad3c00b4-1527-40e4-92ec-7be9d0f5e014 could not be found. {{(pid=117993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-a9edffc5-5897-4274-a2f7-974eaeae3a36 tempest-VolumesSnapshotsTestJSON-1229944336 tempest-VolumesSnapshotsTestJSON-1229944336-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014" status: 404 len: 109 microversion: 2.1 time: 0.036470 Aug 01 15:25:47.466713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 525/1036] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:47 2022] GET /compute/v2.1/os-volumes/ad3c00b4-1527-40e4-92ec-7be9d0f5e014 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 15:25:50.382515 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-556fb741-ff3d-490e-adac-a7109577c85a tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9dffbe4c0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:50.432834 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-556fb741-ff3d-490e-adac-a7109577c85a tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/5d25c86d-564e-4c1b-b98c-f83d4f5c9ca9" status: 200 len: 351 microversion: 2.1 time: 0.056232 Aug 01 15:25:50.433612 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 512/1037] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:50 2022] GET /compute/v2.1/os-volumes/5d25c86d-564e-4c1b-b98c-f83d4f5c9ca9 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:51.787101 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-34f0eaa2-49db-4b41-88a2-22fd728607c8 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ecacd940>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:51.852991 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-34f0eaa2-49db-4b41-88a2-22fd728607c8 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/a7328193-ddc1-4080-abc5-3b0a9c3474ac" status: 200 len: 350 microversion: 2.1 time: 0.070907 Aug 01 15:25:51.853573 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 526/1038] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:51 2022] GET /compute/v2.1/os-volumes/a7328193-ddc1-4080-abc5-3b0a9c3474ac => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:53.291412 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-d9e762f3-664e-489b-876a-0ea96df0ba04 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9dff4f820>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.343971 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-d9e762f3-664e-489b-876a-0ea96df0ba04 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/fef28623-5da9-461a-9bab-bca62ed58484" status: 200 len: 351 microversion: 2.1 time: 0.056856 Aug 01 15:25:53.344545 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 513/1039] 10.222.0.93 () {58 vars in 1245 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes/fef28623-5da9-461a-9bab-bca62ed58484 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:53.358315 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-c50278cd-9d9c-4ee5-8909-f1dc2e897fa9 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec836f70>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.441821 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-c50278cd-9d9c-4ee5-8909-f1dc2e897fa9 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087659 Aug 01 15:25:53.442509 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 527/1040] 10.222.0.93 () {58 vars in 1134 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:53.456985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-a48ff6a3-98db-4ffb-a1e1-860eb35b8cb8 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec030430>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.546572 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-a48ff6a3-98db-4ffb-a1e1-860eb35b8cb8 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093195 Aug 01 15:25:53.547231 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 514/1041] 10.222.0.93 () {58 vars in 1149 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:53.562174 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-24991df6-734b-458a-9b66-76e5211c56f7 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec716ee0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.650111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-24991df6-734b-458a-9b66-76e5211c56f7 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091751 Aug 01 15:25:53.650687 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 528/1042] 10.222.0.93 () {58 vars in 1134 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:25:53.664638 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-dc055b88-56b2-43aa-a3c7-7c4c06076429 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9dfedd3a0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.761245 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-dc055b88-56b2-43aa-a3c7-7c4c06076429 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101025 Aug 01 15:25:53.761736 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 515/1043] 10.222.0.93 () {58 vars in 1167 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:53.777884 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-42e910df-cabc-4742-9e7e-07f8a59a7aa5 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec6344c0>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:53.908975 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-42e910df-cabc-4742-9e7e-07f8a59a7aa5 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.135634 Aug 01 15:25:53.909555 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 529/1044] 10.222.0.93 () {58 vars in 1170 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:53.923715 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-7f589606-c8a6-4a34-a9ab-c7b627b07831 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9dff23700>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.010365 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-7f589606-c8a6-4a34-a9ab-c7b627b07831 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090636 Aug 01 15:25:54.010980 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 516/1045] 10.222.0.93 () {58 vars in 1155 bytes} [Mon Aug 1 15:25:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:25:54.027006 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-48dc46cf-4761-404b-8aa3-8cbf472ceea2 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec95ac10>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.130652 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-48dc46cf-4761-404b-8aa3-8cbf472ceea2 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.107554 Aug 01 15:25:54.131332 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 530/1046] 10.222.0.93 () {58 vars in 1188 bytes} [Mon Aug 1 15:25:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:25:54.149457 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-64b83aa1-4338-46b6-8cfb-550494539847 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] Calling method '.version_select at 0x7fc9ec0678b0>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:25:54.241054 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-64b83aa1-4338-46b6-8cfb-550494539847 tempest-VolumesTestJSON-946137110 tempest-VolumesTestJSON-946137110-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099060 Aug 01 15:25:54.241648 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 517/1047] 10.222.0.93 () {58 vars in 1155 bytes} [Mon Aug 1 15:25:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:26:32.353375 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:26:32.353949 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:27:19.453979 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a19f2a5a-ee80-4c0b-b448-bdeb8bb377b7] AMQP server on 10.222.0.93:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 01 15:27:19.459261 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1951615867", "imageRef": "fcb42b5a-85d6-4df4-a4cf-a1377df642a8", "flavorRef": "452"}} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:19.516053 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.network.neutron [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] validate_networks() for None {{(pid=117993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 15:27:20.013348 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Flavor limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 15:27:20.013771 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Image limits 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 15:27:20.014303 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Flavor pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 15:27:20.014716 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Image pref 0:0:0 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 15:27:20.015133 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.virt.hardware [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 15:27:20.024914 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.025350 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.026151 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:20.026657 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:20.044010 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Getting quotas for project 7e9b91391b71463abc4cb8ecb75ab566. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 15:27:20.048139 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.quota [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Getting quotas for user 08a80c6e01b34deeaf642fe1c4309be1 and project 7e9b91391b71463abc4cb8ecb75ab566. Resources: {'cores', 'ram', 'instances'} {{(pid=117993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 15:27:20.059654 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Going to run 1 instances... {{(pid=117993) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 15:27:20.061977 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fcb42b5a-85d6-4df4-a4cf-a1377df642a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 15:27:20.110038 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-773a6c63-7285-4795-9734-2d6b2c6b6293 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659519 Aug 01 15:27:20.110715 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 531/1048] 10.222.0.93 () {60 vars in 1147 bytes} [Mon Aug 1 15:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 15:27:20.123951 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-13bb80e7-243e-4b05-a80c-743d9c5b128e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:20.124693 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-13bb80e7-243e-4b05-a80c-743d9c5b128e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:20.177971 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-13bb80e7-243e-4b05-a80c-743d9c5b128e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:20.184851 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-13bb80e7-243e-4b05-a80c-743d9c5b128e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1215 microversion: 2.1 time: 0.066238 Aug 01 15:27:20.185420 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 518/1049] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:20 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:21.209817 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:21.210684 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:21.219330 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.219822 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.220635 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:21.223141 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:21.230784 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] [a19f2a5a-ee80-4c0b-b448-bdeb8bb377b7] Reconnected to AMQP server on 10.222.0.93:5672 via [amqp] client with port 55896. Aug 01 15:27:21.294259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:21.306305 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-190e13e1-0038-44df-901b-37128888ebdd tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1285 microversion: 2.1 time: 0.103421 Aug 01 15:27:21.307068 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 532/1050] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:21 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:22.337809 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:22.339048 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:22.346327 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.346773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.347546 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.347984 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.554194 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:22.561845 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-670e4bd9-0589-4555-a193-2688b6aec881 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.237118 Aug 01 15:27:22.562690 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 519/1051] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:22 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:22.783166 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [req-e29f4e52-af49-4813-a92c-0281acfa91f6 req-2080eedf-4e85-45d6-9a16-0c992ea7cf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd4ece2-a852-4c19-99f7-22fa182e16e6", "tag": "f2aacffc-6ac2-4bbc-996e-760953723e3e"}]} {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:22.796184 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-e29f4e52-af49-4813-a92c-0281acfa91f6 req-2080eedf-4e85-45d6-9a16-0c992ea7cf4e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:22.796949 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [req-e29f4e52-af49-4813-a92c-0281acfa91f6 req-2080eedf-4e85-45d6-9a16-0c992ea7cf4e service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:22.810699 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.compute.server_external_events [req-e29f4e52-af49-4813-a92c-0281acfa91f6 req-2080eedf-4e85-45d6-9a16-0c992ea7cf4e service nova] Creating event network-changed:f2aacffc-6ac2-4bbc-996e-760953723e3e for instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 on hv-cinder-80382 Aug 01 15:27:22.816588 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [req-e29f4e52-af49-4813-a92c-0281acfa91f6 req-2080eedf-4e85-45d6-9a16-0c992ea7cf4e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037604 Aug 01 15:27:22.818328 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 533/1052] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:23.583178 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:23.583790 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:23.590484 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.591031 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.591771 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:23.592218 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:23.722049 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:23.730263 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-b96399f3-d04d-424b-afdb-69e1e764cdc4 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.150972 Aug 01 15:27:23.730835 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 520/1053] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:23 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:24.752063 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:24.752710 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:24.760254 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.760740 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.762197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:24.762197 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:24.892970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:24.900530 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-20337d29-a1c4-47f8-9bb1-dd173fdd8831 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.152745 Aug 01 15:27:24.901097 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 534/1054] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:24 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:25.921453 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:25.922058 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:25.930430 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:25.930880 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:25.931678 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:25.932124 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:26.077684 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:26.085829 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-664d38a7-05fa-4047-a9c5-dfe5811075f0 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.168244 Aug 01 15:27:26.086407 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 521/1055] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:25 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 15:27:27.107259 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:27.107870 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:27.115131 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.115577 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.116355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.116815 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.268948 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:27.277885 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5abb9f56-9573-406b-8a7f-f5ccb4d8d191 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.174368 Aug 01 15:27:27.278473 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 535/1056] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:27 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:27.388947 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-a466edad-f448-4b44-9146-e79df66890cd req-1af4db42-194b-431e-9ce7-0e6f6a7a32eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd4ece2-a852-4c19-99f7-22fa182e16e6", "name": "network-vif-plugged", "status": "completed", "tag": "f2aacffc-6ac2-4bbc-996e-760953723e3e"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:27.400117 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-a466edad-f448-4b44-9146-e79df66890cd req-1af4db42-194b-431e-9ce7-0e6f6a7a32eb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:27.400611 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-a466edad-f448-4b44-9146-e79df66890cd req-1af4db42-194b-431e-9ce7-0e6f6a7a32eb service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:27.414822 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-a466edad-f448-4b44-9146-e79df66890cd req-1af4db42-194b-431e-9ce7-0e6f6a7a32eb service nova] Creating event network-vif-plugged:f2aacffc-6ac2-4bbc-996e-760953723e3e for instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 on hv-cinder-80382 Aug 01 15:27:27.420881 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-a466edad-f448-4b44-9146-e79df66890cd req-1af4db42-194b-431e-9ce7-0e6f6a7a32eb service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035602 Aug 01 15:27:27.421970 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 522/1057] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:28.299355 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:28.299903 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:28.307126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.307642 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.308498 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:28.308938 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:28.451683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:28.461256 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-dd23caf5-b7cf-4080-9b19-02d5e688589e tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1315 microversion: 2.1 time: 0.165841 Aug 01 15:27:28.461827 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 536/1058] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:28 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:29.483133 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.483836 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.491279 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.491734 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.492537 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.492985 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.627921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.635773 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-0237b8e3-24d9-4650-8e19-0aaee23a6dd2 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1464 microversion: 2.1 time: 0.156921 Aug 01 15:27:29.636336 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 523/1059] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:29 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:29.680090 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.680685 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.687171 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.687615 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.688368 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.688824 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.713783 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Going to try to terminate instance {{(pid=117993) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 15:27:29.791741 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-5628a47e-ec76-429a-8807-40293c8d1025 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "DELETE /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 204 len: 0 microversion: 2.1 time: 0.115663 Aug 01 15:27:29.792791 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 537/1060] 10.222.0.93 () {58 vars in 1239 bytes} [Mon Aug 1 15:27:29 2022] DELETE /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 15:27:29.802445 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:29.803210 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:29.809372 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.809818 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.810576 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:29.811010 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:29.948504 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.policy [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117992) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:29.956209 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-4c1bc4cb-8725-4f1d-af56-6d4bc02eaa3d tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1470 microversion: 2.1 time: 0.158449 Aug 01 15:27:29.956900 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 524/1061] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:29 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:30.979271 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:30.979976 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:30.982040 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=2 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:30.982743 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG dbcounter [-] [117993] Writing DB stats nova_cell0:SELECT=6 {{(pid=117993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:30.990206 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.990713 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:30.991503 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:30.991942 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:31.133647 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:31.141864 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-4e0ba6ee-fcf6-41b0-8922-078ad3eaeb67 tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1470 microversion: 2.1 time: 0.167103 Aug 01 15:27:31.142461 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 538/1062] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:30 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:32.014946 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [req-e40aba2f-a7d7-4d02-98dd-a3a4f8bb0be3 req-4ffb5a2b-d434-4527-8bc9-030d2cbe3079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd4ece2-a852-4c19-99f7-22fa182e16e6", "name": "network-vif-deleted", "tag": "f2aacffc-6ac2-4bbc-996e-760953723e3e"}]} {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 15:27:32.023921 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG dbcounter [-] [117992] Writing DB stats nova_cell0:SELECT=2 {{(pid=117992) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 15:27:32.033268 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e40aba2f-a7d7-4d02-98dd-a3a4f8bb0be3 req-4ffb5a2b-d434-4527-8bc9-030d2cbe3079 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.033711 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [req-e40aba2f-a7d7-4d02-98dd-a3a4f8bb0be3 req-4ffb5a2b-d434-4527-8bc9-030d2cbe3079 service nova] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.047658 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.compute.server_external_events [req-e40aba2f-a7d7-4d02-98dd-a3a4f8bb0be3 req-4ffb5a2b-d434-4527-8bc9-030d2cbe3079 service nova] Creating event network-vif-deleted:f2aacffc-6ac2-4bbc-996e-760953723e3e for instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 on hv-cinder-80382 Aug 01 15:27:32.054725 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [req-e40aba2f-a7d7-4d02-98dd-a3a4f8bb0be3 req-4ffb5a2b-d434-4527-8bc9-030d2cbe3079 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046502 Aug 01 15:27:32.055670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 525/1063] 10.222.0.93 () {64 vars in 1317 bytes} [Mon Aug 1 15:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 15:27:32.162940 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.api.openstack.wsgi [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:32.163557 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.compute.api [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117993) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:32.172617 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.173111 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.174088 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.174575 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.209783 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:32.210310 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG oslo_concurrency.lockutils [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:32.210701 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.objects.instance [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lazy-loading 'fault' on Instance uuid 6fd4ece2-a852-4c19-99f7-22fa182e16e6 {{(pid=117993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 15:27:32.263970 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: DEBUG nova.policy [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a80c6e01b34deeaf642fe1c4309be1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9b91391b71463abc4cb8ecb75ab566', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 15:27:32.272061 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO nova.api.openstack.requestlog [None req-f022ae56-3caa-403c-a3cd-9e7a17bd5ebf tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 200 len: 1305 microversion: 2.1 time: 0.113103 Aug 01 15:27:32.272683 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: [pid: 117993|app: 0|req: 539/1064] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:32 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 15:27:33.294144 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Calling method '>' {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 15:27:33.294850 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.compute.api [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] [instance: 6fd4ece2-a852-4c19-99f7-22fa182e16e6] Fetching instance by UUID {{(pid=117992) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 15:27:33.302142 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:33.302587 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.303371 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 15:27:33.303804 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG oslo_concurrency.lockutils [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Lock "9208223d-c65f-412b-8e82-b4c7b944694f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 15:27:33.319244 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.wsgi [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] HTTP exception thrown: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Request method failure captured: Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: request: GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 HTTP/1.1 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept: application/json Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Accept-Encoding: identity Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Connection: close Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Length: 0 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Content-Type: application/json Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Host: 10.222.0.93 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Openstack-System-Scope: None Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: User-Agent: python-urllib3/1.26.10 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Auth-Token: gAAAAABi5_DV0qWOEmezt11pWcQDOkPPU6hS2SgRGz9Vt6IiEx7ktoOC752bXw5rXeo3NeQeyXbW5AgXmjtGb-db_D7b9T3g5UN0b0-YxKN7JIrialXoP8lNsQeWtF5-HuvlChFuV_S8MjWQybFG4K3jVxvJf1zb_IluVKbeqcvS5gG8_zbQSYI Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Id: None Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Domain-Name: None Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Identity-Status: Confirmed Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Is-Admin-Project: True Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Id: default Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Domain-Name: Default Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Id: 7e9b91391b71463abc4cb8ecb75ab566 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Project-Name: tempest-VolumesNegativeTest-1049175406 Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Role: member,reader Aug 01 15:27:33.320945 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Roles: member,reader Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7e9b91391b71463abc4cb8ecb75ab566", "adminURL": "http://10.222.0.93:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e9b91391b71463abc4cb8ecb75ab566"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7e9b91391b71463abc4cb8ecb75ab566"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7e9b91391b71463abc4cb8ecb75ab566"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}] Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant: tempest-VolumesNegativeTest-1049175406 Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Id: 7e9b91391b71463abc4cb8ecb75ab566 Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-Tenant-Name: tempest-VolumesNegativeTest-1049175406 Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User: tempest-VolumesNegativeTest-1049175406-project Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Id: default Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Domain-Name: Default Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Id: 08a80c6e01b34deeaf642fe1c4309be1 Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: X-User-Name: tempest-VolumesNegativeTest-1049175406-project Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: method: > Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: exception: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. Aug 01 15:27:33.322741 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: action_args: {'id': '6fd4ece2-a852-4c19-99f7-22fa182e16e6'} Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: {{(pid=117992) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 15:27:33.323768 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. Aug 01 15:27:33.325215 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: ERROR nova.api.openstack.wsgi Aug 01 15:27:33.326481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: DEBUG nova.api.openstack.wsgi [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] Returning 404 to user: Instance 6fd4ece2-a852-4c19-99f7-22fa182e16e6 could not be found. {{(pid=117992) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 15:27:33.326481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO nova.api.openstack.requestlog [None req-f96730f5-b86a-4907-a2c5-b4bb5dcfc26b tempest-VolumesNegativeTest-1049175406 tempest-VolumesNegativeTest-1049175406-project] 10.222.0.93 "GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6" status: 404 len: 111 microversion: 2.1 time: 0.032598 Aug 01 15:27:33.326481 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: [pid: 117992|app: 0|req: 526/1065] 10.222.0.93 () {58 vars in 1236 bytes} [Mon Aug 1 15:27:33 2022] GET /compute/v2.1/servers/6fd4ece2-a852-4c19-99f7-22fa182e16e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 15:28:01.837447 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:28:01.838126 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:28:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:28:21.296856 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:28:21.297483 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Mon Aug 1 15:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:29:45.338943 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:29:45.340670 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Mon Aug 1 15:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:29:52.364077 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:29:52.364794 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:30:22.978201 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:30:22.978895 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:30:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:31:21.846921 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:31:21.848005 dv-cinder-803823-14-iscsi devstack@n-api.service[117993]: Mon Aug 1 15:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 15:31:41.305712 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 15:31:41.306403 dv-cinder-803823-14-iscsi devstack@n-api.service[117992]: Mon Aug 1 15:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!